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ABSTRACT 


The  lack  of  a  standard  method  for  estimating  the  errors  associated  with  gas  turbine 
performance  data  has  made  it  impossible  to  compare  measurement  systems  between 
facilities,  and  there  has  been  confusion  over  the  interpretation  of  error  analysis. 
Therefore,  a  standard  uncertainty  methodology  is  proposed  in  this  Handbook.  The 
mathematical  uncertainty  model  presented  is  based  on  two  components  of  measurement 
error:  the  fixed  (bias)  error  and  the  random  (precision)  error.  The  result  of  applying  the 
model  is  an  estimate  of  the  error  in  the  measured  performance  parameter.  The 
uncertainty  estimate  is  the  interval  about  the  measurement  which  is  expected  to 
encompass  the  true  value.  The  propagation  of  error  from  basic  measurements  through 
calculated  performance  parameters  is  presented.  Traceability  of  measurement  back  to  the 
National  Bureau  of  Standards  and  associated  error  sources  is  reviewed. 
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1.1  OBJECTIVE 

The  objective  of  this  Handbook  is  to  present  a  standard  method  of  treating 
measurement  error1  or  uncertainty  for  gas  turbine  engine  performance  parameters,  such 
as  thrust,  airflow,  and  thrust  specific  fuel  consumption.  The  need  for  a  standard  is 
obvious  to  those  who  have  reviewed  the  numerous  methods  currently  used.  The  subject  is 
complex  and  involves  both  engineering  and  statistics.  Only  one  method  is  presented 
herein  without  alternative  paths.  A  single  standard  method  is  required  to  make 
comparisons  between  engine  manufacturers  and  between  facilities.  However,  it  must  be 
recognized  that  no  single  method  will  give  a  rigorous,  scientifically  correct  answer  for  all 
situations.  Further,  even  for  a  single  set  of  data,  the  task  of  finding  and  proving  one 
method  to  be  correct  is  usually  impossible.  The  method  selected  is  believed  to  be  most 
universally  applicable.  It  is  identical  with  the  measurement  uncertainty  model  used  in  the 
rocket  engine  industry  which  has  been  well  received  (“ICRPG  Handbook  for  Estimating 
the  Uncertainty  in  Measurements  made  with  Liquid  Propellant  Rocket  Engine  Systems,” 
CPIA  No.  180,  AD855130,  April  30,  1969). 

There  are  numerous  examples  for  illustration.  An  effort  has  been  made  to  use  simple 
prose  with  a  minimum  of  jargon. 

1.2  SCOPE 

This  Handbook  presents  a  working  outline  detailing  and  illustrating  the  techniques 
for  estimating  measurement  uncertainty.  Section  II  describes  the  mathematical  model  for 
a  typical  performance  parameter  (thrust  specific  fuel  consumption).  Sections  III,  IV,  V, 
and  VI  treat  errors  associated  with  the  measurement  of  force,  fuel  flow,  pressure  and 
temperature,  and  airflow.  Each  section  includes  a  discussion  of  the  methods  of  calibration 
and  lists  of  the  elemental  errors  and  examples  of  the  statistical  techniques.  Section  VII 
describes  the  calculations  of  the  uncertainty  in  net  thrust  and  thrust  specific  fuel 
consumption  at  altitude  conditions.  Section  VIII  describes  and  illustrates  several  special 
methods.  Section  IX  is  the  Glossary.  Appendixes  with  tables,  derivations,  and  proofs  are 
found  at  the  end  of  the  Handbook. 

1.3  MEASUREMENT  ERROR 

All  measurements  have  measurement 
errors.  These  errors  are  the  differences 
between  the  measurements  and  the  true 
value  defined  by  the  National  Bureau  of 
Standards  (NBS).  Uncertainty  is  the  maxi¬ 
mum  error  which  might  reasonably  be 
expected  and  is  a  measure  of  accuracy,  i.e., 
the  closeness  of  the  measurement  to  the  true 
value.  Measurement  error  has  two  com¬ 
ponents:  a  fixed  error  and  a  random  error. 

1For  a  definition  of  terms  used  in  this  Handbook,  see  the  Glossary  in  Section  IX. 


Measured  Value  True  (NBS)  Value 


0.980  0.985  0.990  0.995  1.0 


Parameter  Measurement  Value 

Fig.  1-1  Measurement  Error 
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1.3.1  Precision  (Random  Error) 


Random  error  is  seen  in  repeated  measurements.  Measurements  do  not  and  are  not 
expected  to  agree  exactly.  There  are  always  numerous  small  effects  which  cause 
disagreements.  The  variation  between  repeated  measurements  is  called  precision  error.  The 

standard  deviation  (cr)  is  used  as  a 
measure  of  the  precision  error.  A 
large  standard  deviation  means 
large  scatter  in  the  measurements. 
The  statistic  (s)  is  calculated  to 
estimate  the  standard  deviation 
and  is  called  the  precision  index 


N 

2  (x.  - 

t=i  1 


x) 


Parameter  Measurement  Value 


Fig.  1-2  Precision  Error 


N  -  1 


where  N  is  the  number  of  measure¬ 
ments  made  and  X  is  the  average 
value  of  individual  measurements  Xi. 


1.3.2  Bias  (Fixed  Error) 


The  second  component,  bias,  is  the 
constant  or  systematic  error.  In  repeated 
measurements,  each  measurement  has  the 
same  bias.  The  bias  cannot  be  determined 
unless  the  measurements  are  compared 
with  the  true  value  of  the  quantity 
measured. 

Bias  is  categorized  into  five  classes: 
(1)  large  known  biases,  (2)  small  known 
biases,  (3)  large  unknown  biases,  and 
small  unknown  biases  which  may  have 
(4)  unknown  sign  (±)  or  (5)  known  sign. 


Fig.  1-3  Bias  Error 


Known  Sign 
and  Magnitude 

Unknown  Magnitude 

Large 

(1)  Calibrated 

(3)  Assumed 

to  be 

Out 

Eliminated 

(2)  Negligible, 

(4)  Unknown 

(5)  Known 

Contributes 

Sign 

Sign 

Small 

to 

Bias  Limit 

Contributes  to 

Bias  Limit 

Fig.  1-4  Five  Types  of  Bias  Errors 


2 


AEDC-TR-73-5 


1.3. 2.1  Large  Known  Biases 

The  large  known  biases  are  eliminated  by  comparing  the  instrument  with  a  standard 
instrument  and  obtaining  a  correction.  This  process  is  called  calibration. 

1.3. 2.2  Small  Known  Biases 

Small  known  biases  may  or  may  not  be  corrected  depending  on  the  difficulty  of  the 
correction  and  the  magnitude  of  the  bias. 

1 .3.2.3  Large  Unknown  Biases 

Unknown  biases  are  not  correctable.  That  is,  they  may  exist,  but  the  magnitude  of  the 
bias  is  not  known,  and  perhaps  even  the  sign  is  not  known. 

Every  effort  must  be  made  to  eliminate  all  large  unknown  biases.  The  introduction 
of  such  errors  converts  the  controlled  measurement  process  into  an  uncontrolled 
worthless  effort.  Large  unknown  biases  usually  come  from  human  errors  in  data 
processing,  incorrect  handling  and  installation  of  instrumentation,  and  unexpected 
environmental  disturbances  such  as  shock  and  bad  flow  profiles.  In  a  well-controlled 
measurement  process,  the  assumption  is  that  there  are  no  large  unknown  biases.  To  ensure 
that  a  controlled  measurement  process  exists,  all  measurements  should  be  monitored  with 
statistical  quality  control  charts.  A  list  of  references  describing  the  use  of  statistical 
quality  control  charts  is  included  at  the  end  -  of  this  section.  Drifts,  trends,  and 
movements  leading  to  out-of-control  situations  should  be  identified  and  investigated. 
Histories  of  data  from  calibrations  are  required  for  effective  control.  It  is  assumed 
throughout  this  Handbook  that  these  precautions  are  observed  and  that  the  measurement 
process  is  in  control;  if  not,  the  methods  contained  herein  are  invalid. 

1. 3.2.4  Small  Biases,  Unknown  Sign,  and  Unknown  Magnitude 

In  most  cases,  the  bias  error  is  equally  likely  to  be  plus  or  minus  about  the 
measurement.  That  is,  it  is  not  known  if  the  limit  is  positive  or  negative,  and  the  estimate 
reflects  this.  The  bias  limit  is  estimated  as  an  upper  limit  on  the  maximum  fixed  error. 
For  example,  ±5  pounds  is  a  typical  bias  limit. 

It  is  both  difficult  and  frustrating  to  estimate  the  limit  of  an  unknown  bias.  To 
determine  the  exact  bias  in  a  measurement,  it  would  be  necessary  to  compare  the  true 
value  and  the  measurements.  This  is  almost  always  impossible.  An  effort  must  be  made  to 
obtain  special  tests  or  data  that  will  provide  bias  information.  The  following  are  examples 
of  such  data: 

1.  Interlab,  interfacility,  intercompany  tests  on  measurement  devices,  test 
rigs,  and  full-scale  engines. 

2.  Flight  test  data  versus  altitude  test  chamber  data  versus  ground  test  data. 

3.  Special  comparisons  of  standards  with  instruments  in  the  actual  test 
environment. 
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4.  Ancillary  or  concomitant  functions  that  provide  the  same  performance 
parameter;  i.e.,  in  an  altitude  engine  test,  airflow  may  be  measured  with 
(1)  an  orifice  and  (2)  a  bellmouth,  (3)  estimated  from  compressor 
speed-flow  rig  data,  (4)  estimated  from  turbine  flow  parameter,  and  (5)  jet 
nozzle  calibrations. 

5.  When  it  is  known  that  a  bias  results  from  a  particular  cause,  special 
calibrations  may  be  performed  allowing  the  cause  to  perturbate  through  its 
complete  range  to  determine  the  range  of  bias. 

If  there  is  no  source  of  data  for  bias,  the  judgment  of  the  most  knowledgeable 
instrumentation  expert  on  the  measurement  must  be  used.  However,  without  data,  the 
upper  limit  on  the  largest  possible  bias  error  must  reflect  the  lack  of  knowledge. 

1. 3.2.5  Small  Biases,  Known  Sign,  and  Unknown  Magnitude 

Sometimes  the  physics  of  the  measurement  system  provide  knowledge  of  the  sign 
but  not  the  magnitude  of  the  bias.  For  example,  thermocouples  radiate  and  conduct 
energy  to  indicate  lower  temperatures.  The  bias  limits  which  result  are  nonsymmetrical, 
i.e.,  not  of  the  form  ±b.  They  are  of  the  form  +_J?  where  both  limits  may  be  positive  or 
negative  or  the  limits  may  be  of  mixed  sign  as  indicated.  Table  I  below  lists  several 
nonsymmetrical  bias  limits  for  illustration. 


Table  I  Nonsymmetrical  Bias  Limits 


Bias  Limits 

Explanation 

0,  +10  deg 
-5, +15  lb 
+3,  +7  psia 
-8,  -3  deg 

The  bias  will  range  from  zero  to  plus  10  deg. 

The  bias  will  range  from  minus  5  to  plus  1 5  lb. 

The  bias  will  range  from  plus  3  to  plus  7  psia. 

The  bias  will  range  from  minus  8  to  minus  3  deg. 

In  summary,  measurement  systems  are  subject  to  two  types  of  errors,  bias  and 
precision  error  (Fig.  1-5).  One  sample  standard  deviation  is  used  as  the  precision  index. 
The  bias  limit  is  estimated  as  an  upper  limit  on  the  maximum  fixed  error. 

1.4  MEASUREMENT  UNCERTAINTY 

For  simplicity  of  presentation  a  single  number  (some  combination  of  bias  and 
precision)  is  needed  to  express  a  reasonable  limit  for  error.  The  single  number  must  have 
a  simple  interpretation  (the  largest  error  reasonably  expected)  and  be  useful  without 
complex  explanation.  It  is  impossible  to  define  a  single  rigorous  statistic  because  the  bias  is 
an  upper  limit  based  on  judgment  which  has  unknown  characteristics.  Any  function  of  these 
two  numbers  must  be  a  hybrid  combination  of  an  unknown  quantity  (bias)  and  a  statistic 
(precision).  However,  the  need  for  a  single  number  to  measure  error  is  so  great  that  the 
adoption  of  an  arbitrary  standard  is  warranted.  The  standard  most  widely  used  is 
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Parameter  Measurement 


a.  Unbiased,  Precise,  Accurate 


c.  Unbiased,  Imprecise,  Inaccurate 


Fig.  1-5  Measurement  Error 


Average  of  All 


Parameter  Measurement 


b.  Biased,  Precise,  Inaccurate 

Average  of  All 


Parameter  Measurement 


d.  Biased,  Imprecise,  Inaccurate 
Precision,  and  Accuracy) 


the  bias  limit  plus  a  multiple  of  the  precision  index.  This  method  is  recognized  and 
recommended  by  the  NBS2  and  has  been  widely  used  in  industry. 

Uncertainty  (Fig.  1-6)  may  be  centered  about  the  measurement  and  is  defined  herein  as: 

U  =  ±(B  +  t95S)  (1-1) 

where  B  is  the  bias  limit,  S  is  the  precision  index,  and  tgs  is  the  95th  percentile  point 
for  the  two-tailed  Students  “t”  distribution  (Table  E-l,  Appendix  E).  The  t  value  is  a 
function  of  the  number  of  degrees  of  freedom  (df)  used  in  calculating  S.  For  small 
samples,  t  will  be  large,  and  for  larger  samples  t  will  be  smaller,  approaching  1.96  as  a 
lower  limit.  The  use  of  the  t  arbitrarily  inflates  the  limit  U  to  reduce  the  risk  of 
underestimating  S  when  a  small  sample  is  used  to  calculate  S.  Since  30  degrees  of  freedom 
yield  a  t  of  2.04  and  infinite  degrees  of  freedom  yield  a  t  of  1.96,  an  arbitrary  selection 
of  t  =  2  for  values  of  df  from  30  to  infinity  was  made,  i.e.,  U  =  ±(B  +  2S),  when  df  >  30. 

In  a  sample,  the  number,  of  degrees  of  freedom  is  the  size  of  the  sample.  When  a 
statistic  is  calculated  from  the  sample,  the  degrees  of  freedom  associated  with  the  statistic 


2Eisenhart,  C.  “Expression  of  Uncertainties  of  Final  Results,  Precision  Measurement  and  Calibration,”  NBS 
Handbook  91,  Vol  I,  February  1969,  pp.  69-72. 

Ku,  H.  H.  “Expressions  of  Imprecision,  Systematic  Error,  and  Uncertainty  Associated  with  a  Reported  Value, 
Precision  Measurement  and  Calibration,”  NBS  Handbook  91,  Vol  I,  February  1969,  pp.  73-78. 
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are  reduced  by  one  for  every  estimated  parameter  used  in  calculating  the  statistic.  For 
example,  from  a  sample  of  size  N,  X  is  calculated: 

N 

X  =  2  Xj/N  (1-2) 

i=l 

which  has  N  degrees  of  freedom  and 


which  has  N-l  degrees  of  freedom  because  X  (based  on  the  same  sample  of  data)  is  used 
to  calculate  S.  In  calculating  other  statistics,  more  than  one  degree  of  freedom  may  be 
lost.  For  example,  in  calculating  the  standard  error  of  a  curve  fit,  the  number  of  degrees 
of  freedom  which  are  lost  is  equal  to  the  number  of  estimated  coefficients  for  the  curve. 

It  is  recommended  that  the  uncertainty  parameter  (U)  be  used  for  simplicity  of 
presentation;  however,  the  components  (bias,  precision,  and  degrees  of  freedom)  should 
be  available  in  an  appendix  or  in  supporting  documentation.  These  three  components 
may  be  required  (1)  to  substantiate  and  explain  the  uncertainty  value,  (2)  to  provide  a 
sound  technical  base  for  improved  measurements,  and  (3)  to  propagate  the  uncertainty 
from  measured  parameters  to  performance  parameters,  and  from  performance  parameters 


Measurement 
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to  other  more  complex  performance  parameters  (i.e.  fuel  flow  to  Thrust  Specific  Fuel 
Consumption  (TSFC),  TSFC  to  aircraft  range,  etc.).  Although  uncertainty  is  not  a 
statistical  confidence  interval,  it  is  an  arbitrary  substitute  which  is  probably  best 
interpreted  as  the  largest  error  expected.  Under  any  reasonable  assumption  for  the 
distribution  of  bias,  the  coverage  of  U  is  greater  than  95  percent,  but  this  cannot  be 
proved  as  the  distribution  of  bias  is  both  unknown  and  unknowable. 

If  there  is  a  nonsymmetrical  bias  limit  (Fig.  1-7),  the  uncertainty  U  is  no  longer 
symmetrical  about  the  measurement.  The  upper  limit  of  the  interval  is  defined  by  the 
upper  limit  of  the  bias  interval  (B+).  The  lower  limit  is  defined  by  the  lower  limit  of  the 
bias  interval  (B“). 


Measurement 


Fig.  1-7  Measurement  Uncertainty,  Nonsymmetrical  Bias 

The  uncertainty  interval  U  is  U"  =  B“  -  t95  S  to  U+  =  B+  +  t95  S. 

Table  II  shows  the  uncertainty  U  for  the  nonsymmetrical  bias  limits  of  Table  I.  The 
S  and  t9  5  are  assumed  to  be  1  unit  and  2  units  for  each  case. 


Table  II  Uncertainty  Intervals  Defined  by  Nonsymmetrical  Bias  Limits 


B- 

B+ 

t95  S 

u- 

(Lower  limit  for  U) 

U+ 

(Upper  limit  for  U) 

0  deg 

+10  deg 

2  deg 

-2  deg 

+12  deg 

-5  lb 

+15  lb 

21b 

-7  lb 

+17  lb 

+3  psia 

+7  psia 

2  psia 

+1  psia 

+9  psia 

-8  deg 

-3  deg 

2  deg 

-10  deg 

-1  deg 
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The  proper  method  for  combining  elemental  measurement  uncertainty  values  is  to 
determine  the  root-sum-square  values  of  the  elemental  bias  limits  and  the  elemental 
precision  indices  separately.  Then,  apply  the  uncertainty  formula  to  the  combined  bias 
limits  and  precision  indices.  In  some  cases,  the  same  value  will  be  obtained  if  the 
uncertainties  are  root-sum-squared  directly.  However,  this  is  not  a  general  rule,  and  large 
errors  in  the  combined  uncertainty  (10  to  25  percent)  can  result.  Further,  the 
root-sum-squared  uncertainty  value  will  be  smaller  (optimistic)  than  the  proper 
uncertainty  estimate,  and  the  estimate  is  a  significant  underestimate  of  the  true 
measurement  error. 

For  example,  in  combining  the  following  uncertainties  the  root-sum-square  of  the 
uncertainties  was  18.38  units.  The  correct  value  was  23.21  units. 

Bias  Limit  (B)  Precision  Index  (S)  Uncertainty 

1  6  ±13 

11  1  ±13 

where  Uncertainty  =  ±(B  +  2S). 

Now  the  bias  limit  for  the  combined  parameter  is  the  root-sum-square  of  1  and  1 1 : 

B  =  yj  l2  +  ll2  =  yjl22  =  11.05 

The  precision  index  for  the  combined  parameter  is  the  root-sum-square  of  6  and  1 : 

S  =  yj  6  2  +  l2  =  y/37  =  6.08 


The  Uncertainty  is  thus: 

U  =  ±(B  +  2S)  =  ±[11.05  +  2(6.08)1  =  ±23.21  / 

The  root-sum-square  of  the  original  uncertainties  is 

y/(  13)2  +  (13)*"  =  y/l69  +  169  =  ^338  =  18.38  / 

Now,  23.21  -  18.38  x  lQQ  =  26>3% 

18.38 

and  over  25  percent  error  nas  been  introduced  just  because  of  the  wrong  propagation  of 
error  formula. 

1.5  PROPAGATION  OF  MEASUREMENT  ERRORS 

Rarely  are  performance  parameters  measured  directly;  usually  more  basic  quantities 
such  as  temperature,  force,  pressure,  and  fuel  flow  are  measured,  and  the  performance 
parameter  is  calculated  as  a  function  of  the  measurements.  Error  in  the  measurements  is 
propagated  to  the  parameter  through  the  function.  The  effect  of  the  propagation  may  be 
approximated  with  the  Taylor’s  series  methods. 
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1.5.1  Engine  Inlet  Airflow 


Engine  inlet  airflow  is  deter¬ 
mined  by  the  use  of  a  choked 
venturi  and  measurements  of  up¬ 
stream  temperature  and  stag¬ 
nation  pressure  (Fig.  1-8). 

The  flow  (Wa)  is  calculated  from 


To 

Engine 

Inlet 


wa  -  Fa/ Aef(Pl//f7  (14) 
where 


Fig.  1-8  Flow  through  a  Choked  Venturi 


Fa  is  the  factor  to  account  for  thermal  expansion  of  the  venturi 
Aeff  is  the  effective  venturi  throat  area 
Pi  is  the  total  (stagnation)  pressure  upstream 
Ti  is  the  total  temperature  upstream 
C*  is  the  factor  to  account  for  the  properties  of  the  air 
(critical  flow  constant) 

The  precision  index  for  the  flow  (S\ya)  is  calculated  using  the  Taylor’s  series 
expansion  (this  method  is  derived  in  Appendix  B): 


dw 

a 

“  denotes  the  partial  derivative  of  Wa  with  respect  to  Fa  . 


Taking  the  necessary  derivatives  gives 


By  inserting  the  nominal  values  and  precision  errors^  from  Table  III  into  Eq.  (1-6),  the 
precision  index  of  0.3658  lb/sec  for  engine  airflow  is  obtained. 


The  bias  limit  in  the  flow  calculation  is  propagated  from  the  bias  limits  of  the 
measured  variables.  Using  the  Taylor’s  series  formula  gives 
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For  this  example,  where  Wa  =  FAC*AeffPi  /v/Tj": 


Taking  the  necessary  derivatives  gives 


By  inserting  the  nominal  values  and  bias  limits  of  the  measured  parameters  from 
Table  III  into  Eq.  (1-9),  a  bias  limit  of  0.6987  lb/sec  is  obtained  for  a  nominal  engine 
airflow  of  248.23  Ib/sec. 


Table  III  Flow  Data 
Wa  =  FaD'A^/Vt; 


Parameter 

Units 

Nominal 

Precision  Index 
(One  Standard  Deviation) 

Bias  Limit 

fa  ■ 

lbm  R1/2 

1.00 

0.0 

0.001 

C* 

lb  sec 

0.532 

0.0 

0.000532 

Aeff 

in.2 

296. 

0.148 

0.592 

Pi 

psia 

36.8 

0.05 

0.05 

Ti 

°R 

545. 

0.3 

0.3 

,'.Wa 

jj»gi 

sec 

248.23 

0.3658 

0.6987 

To  propagate  nonsymmetrical  bias  limits,  the  bias  limit  portion  of  the  analysis  must 
be  completed  for  both  the  upper  and  the  lower  limits.  Then,  the  two  results  are 
combined  as  illustrated  in  Table  II.  There  is  a  more  detailed  illustration  of  propagation  of 
nonsymmetrical  bias  limits  in  Section  VIII. 

1.5.2  Thrust  Specific  Fuel  Consumption  (TSFC) 

The  goal  of  any  analysis  of  measurement  system  errors  is  to  determine  the  resulting 
errors  in  the  reduced  parameters,  for  example  TSFC,  which  is  calculated  as  the  ratio  of 
fuel  flow  (Wf)  to  net  thrust  (FN);  TSFC  =  Wf/Fjj.  Net  thrust  and  TSFC  uncertainty 
calculations  are  described  in  Section  VII.  The  technique  for  relating  the  errors  of 
measurement  to  the  errors  in  the  reduced  parameters  is  based  on  a  Taylor’s  Series 
expansion  from  the  calculus.  The  Taylor’s  expression  for  errors  in  thrust  specific  fuel 
consumption  is 
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atsfc  = 


<?TSFC 

dwf 


AWf 


+ 


dTSFC 


af* 


1 


wf 

AWf  -  AFn 
fn 


(MO) 


Where  3TSFC/3Wf  and  3TSFC/8Fn  are  the  partial  derivatives  of  thrust  specific  fuel 
consumption  with  respect  to  fuel  flow  and  net  thrust.  The  precison  index  is 
approximated  by 


3tsfc 


V? 


dTSFC 
dW 


f 


[  dTSFC 

V  dF 


/-w. 


(Ml) 


For  example,  the  following  hypothetical  data  were  used  to  estimate  thrust  specific  fuel 
consumption  uncertainty : 


Parameter 


Nominal 


Bias  Precision  Degrees  of  Uncertainty 
Limit  Index  Freedom  Limit 


Thrust  (Fn)  10,000 
Fuel  Flow  (Wf)  10,000 


18.1  lbf  37.8  lbf  57 

50  lbm/hr  50  lbm/hr  60 


93.7  lbf 
150  lbm/hr 


SH 


The  nominal  thrust  specific  fuel  consumption  is  calculated  from  Wf/FN : 


G  _  10,000  lbm/hr 
Fn  _  10,000  lbf 


1.0  lbm/lbf-hr 


The  precision  index  of  thrust  specific  fuel  consumption  is 


STSFC 


■# 


/-wf 


/GO 

o,ooo^ 


' -10,000 
(  10,0002 


X  37.8 


=  ±0.0063  lbm/lbf-hr  F  '  HcWilAp/J 
The  propagation  formula  is  similar  for  bias 


B 


TSFC 


l(  50  ' 

"Y  \10,000 


+  p±M2218.i 

\10,0002  / 


=  ±0.0053  lbm/lbf-hr  F  * 


(M2) 

(M3) 
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The  degrees  of  freedom  for  the  TSFC  precision  index  can  be  found  using  the 
Welch-Satterthwaite  technique.  In  this  situation,  the  partial  derivative  weighting  factors, 
which  are  used  in  the  calculation  of  the  precision  index,  must  also  be  used  in  the 
Welch-Satterthwaite  formula.  Note:  The  calculation  is  carried  out  to  illustrate  the  use  of 
the  partial  derivatives  with  the  Welch-Satterthwaite.  It  is  not  necessary  to  calculate  the 
degrees  of  freedom  for  TSFC  since  the  degrees  of  freedom  for  thrust  and  fuel  flow  are 
57  and  60,  respectively.  The  expected  minimum  result  would  be  57.  The  t  multiple  is 
essentially  2.0  for  degrees  of  freedom  greater  than  thirty  (Section  1.4).  When  the  degrees 
of  freedom  for  each  component  are  greater  than  30,  the  Welch-Satterthwaite  procedure 
can  be  omitted  and  t  =  2.0  can  be  used. 


7  1  rn\2  /"lO.OOO  \2T 

(ip’000  )  +  (io,ooo2  X  )_ 

'  (_!_»  „Y  *».»)• 

\io,ooo  /  \io,oo(r  / 


60 


57 


=  110 

The  t  value  is  2,  and  the  uncertainty  is 

U  =  ±(B+t95S)  =  ±[0.0053+  (2.0X0.0063)]  =  ±0.0179  lbm/lbf-hr  (/ 


The  results  of  the  error  analysis  are  presented  in  Table  IV. 

The  uncertainty  limit  as  a  percent  of  the  nominal  value  may  be  calculated  by 
dividing  the  uncertainty  limit  in  engineering  units  by  the  corresponding  nominal  value 
and  then  multiplying  by  100. 

The  propagation  of  error  formulas  used  in  this  section  are  derived  and  discussed  in 
Appendix  B. 
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Table  IV  Uncertainty  Components  3  ^ 


Parameter 

Nominal 

Value 

Bias  Limit 

Precision  Error 

Degrees  of 
Freedom 

.Uncertainty 

Thrust,  Fjsj 

Fuel  Flow,  Wf 

Thrust  Specific 

Fuel  Consumption 

10,000  Ibf 
10,000  lbm/hr 

1.0  lbm/lbf-hr 

18.1  lbf 

50  lbm/hr 

0.0053  lbm/lbf-hr 

37.8  lbf 

50  lbm/hr 

0.0063  lbm/lbr-hr 

57 

60 

110 

93.7  lbf 

150  lbm/hr 

0.01 8  lbm/lbf-hr 

1.6  MEASUREMENT  PROCESS 

In  making  uncertainty  analyses,  definition  of  the  measurement  process  is  of  utmost 
importance.  Uncertainty  statements  are  based  on  a  well-defined  measurement  process.  A 
typical  process  is  the  measurement  of  thrust  specific  fuel  consumption  (TSFC)  for  a  given 
gas  turbine  engine  at  a  given  test  facility.  The  uncertainty  of  this  measurement  process 
will  contain  precision  errors  due  to  variations  between  installations,  test  stands,  and 
measurement  instruments.  This  uncertainty  will  be  greater  than  the  uncertainty  for 
comparative  tests  to  measure  TSFC  on  a  single  test  stand  for  a  single  engine,  a  different 
measurement  process.  The  single  stand,  single  engine,  back-to-back  test  would  assume  that 
most  installation  and  calibration  errors  would  be  biases  rather  than  precision  errors. 
Biases  may  be  ignored  in  comparative  testing  in  that  the  same  equipment  is  used  for  all 
testing,  and  biases  do  not  affect  the  comparison  of  one  test  with  another  (the  test 
objective  being  to  determine  if  a  design  change  is  beneficial).  The  single  stand,  single 
engine  model  and  other  comparative  tests  are  treated  in  Section  8.3. 

Because  the  definition  of  the  measurement  process  is  a  prerequisite  to  defining  the 
mathematical  model,  all  the  elemental  bias  and  precision  error  sources  which  affect  the 
measurements  must  be  listed.  Then,  it  must  be  determined  how  the  bias  and  precision 
errors  are  related  to  the  engine  performance  parameter.  Based  on  this  defined 
measurement  process,  the  errors  may  be  biases  or  precision  errors. 

The  bias  and  precision  errors  related  to  the  defined  measurement  process  for  thrust 
specific  fuel  consumption  are  listed  in  Section  II.  Uncertainty  analyses  should  be  repeated 
periodically.  Continuous  validation  is  essential. 

1.7  REPORTING  ERROR 

The  definition  of  the  components,  bias  limit,  precision  index,  and  the  limit  (U) 
suggests  a  format  for  reporting  measurement  error.  The  format  will  describe  the 
components  of  error,  which  are  necessary  to  estimate  further  propagation  of  the  errors, 
and  a  single  value  (U)  which  is  the  largest  error  expected  from  the  combined  errors. 
Additional  information,  degrees  of  freedom  for  the  estimate  of  S,  is  required  to  use  the 
precision  index.  These  numbers  provide  all  the  information  necessary  to  describe  and  use 
the  measurement  error.  The  reporting  format  is: 

1 .  S,  the  estimate  of  the  precision  index,  calculated  from  data. 

2.  df,  the  degrees  of  freedom  associated  with  the  estimate  of  the  precision 
index  (S). 
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3.  B,  the  upper  limit  of  the  bias  error  of  the  measurement  process  or  B“  and 
B+  if  the  bias  limit  is  nonsymmetrical. 

4.  U  =  ±(B  +  tgs  S),  the  uncertainty  limit,  beyond  which  measurement  errors 
would  not  reasonably  fall.  The  t  value  is  the  95th  percentile  of  the  two-tailed 
Student  “t”  distribution. 

5.  U,  the  interval  beiween  U"  =  B"  -  tgsS  and  U+  =  B+  +  t9sS.  These  limits 
should  be  reported  when  the  bias  limit  is  nonsymmetrical. 

The  modei  components,  S,  df,  B,  ana  CJ,  are  required  to  report  the  error  of  any 
measurement  process.  As  recommended  in  Section  1 .4,  for  simplification,  the  first  three 
components  may  be  relegated  to  the  detailed  sections  of  uncertainty  reports  and 
presentations.  The  first  three  components,  S,  df,  and  B,  are  necessary  to  propagate  the 
errors  further,  to  propagate  the  uncertainty  to  more  complex  parameters,  and  to 
substantiate  the  uncertainty  limit. 

1.8  TRACEABILITY 

In  recent  years  the  demanding  requirements  of  military  and  commercial  aircraft  have 
led  to  the  establishment  of  extensive  hierarchies  of  standards  laboratories  within  the 
military  and  the  aerospace  industry.  The  NBS  is  at  the  apex  of  these  hierarchies, 
providing  the  ultimate  reference  for  each  standards  laboratory.  It  has  become 
commonplace  for  Government  contracting  agencies  to  require  contractors  to  establish  and 
prove  traceability  of  their  measurements  to  the  NBS.  This  requirement  has  created  even 
more  extensive  hierarchies  of  standards  within  the  individual  standards  laboratories.  At 
each  level  of  these  hierarchies,  formal  calibration  procedures  are  used.  These  procedures 
not  only  define  calibration  methods  and  intervals  but  also  specify  just  what  information 
must  be  recorded  during  a  calibration,  i.e.,  meter  model,  serial  number,  calibration  date, 
etc.,  in  addition  to  actual  measurement  data. 

The  measurement  process  takes  place  over  a  long  period  of  time.  During  this  period, 
many  calibrations  occur  at  each  level.  Therefore,  the  precision  errors  of  each  comparison 
are  precision  errors  affecting  the  measurement  process.  The  overall  effect  on  the 
measurement  of  force  is  a  random  (precision  error)  one.  Therefore,  the  resultant  overall 
precision  index  is  the  root-sum-square  of  the  individual  precision  indices.  For  each 
comparison,  the  resultant  calibration  value  is  usually  the  average  of  several  readings.  The 
associated  precision  index  would  be  a  standard  error  of  the  mean  (or  standard  error  of 
estimate)  for  that  number  of  readings.  The  precision  index  is 

s  =  ySl2  +  s22  +  s32  +  s42  d-16) 

for  four  steps  in  the  calibration  process. 

The  degrees  of  freedom  for  each  precision  index  may  be  combined  using  the 
Welch-Satterthwaite  formula  to  provide  an  estimate  of  the  degrees  of  freedom  for  the 
combined  precision  index. 
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df 


2  2 
s2  +  S3  + 


2\2 


s  4  s  4  s  4 
‘s2  3  4 


(1-17) 


This  technique  was  simulated  for  various  sample  sizes  and  provides  the  best  known 
estimate  of  the  equivalent  degrees  of  freedom.  The  results  of  the  simulation  and  the 
further  use  of  the  technique  are  discussed  in  CPIA  No.  180  (AD855130).  If  non-integral 
values  of  df  result  from  the  Welch- Satterthwaite  estimate,  appropriate  Student’s  t  values 
can  be  found  by  interpolating  from  the  table  in  Appendix  E. 


The  unknown  bias  error  limit  for  the  end  instrument  is  usually  a  function  of  many 
elemental  bias  limits,  perhaps  ten  or  twenty.  It  is  unreasonable  to  assume  that  all  of  these 
biases  are  cumulative.  There  must  be  a  cancelling  effect  because  some  are  positive  and 
some  are  negative.  For  this  reason,  the  arbitrary  rule  that  the  bias  limit  B  will  be  the 
root-sum-square  of  the  elemental  bias  limit  estimates  was  adopted: 

B  =  V  bj2  4-  b22  +  b32  +  ...  +  bL2  (1-18) 

(where  L  is  the  number  of  sources  of  bias . ) 

In  combining  elemental  nonsymmetrical  bias  limits,  the  upper  limits  should  be 
root-sum-squared  to  determine  the  combined  upper  limit.  The  lower  limits  should  be 
root-sum-squared  to  determine  the  combined,  lower  limit.  The  resulting  will  be 
nonsymmetrical  bias  limits.  An  example  of  an  error  analysis  containing  nonsymmetrical 
bias  limits  is  given  in  Section  VIII. 


The  uncertainty  in  the  measurement  instrument  due  to  calibration  is  calculated  using 
the  uncertainty  formula: 


U  =  ±(B  +  t95S) 


(M9) 


where  S  is  the  precision  index  calculated  from  Eq.  (1-16). 
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SECTION  II 

UNCERTAINTY  MODEL 


2.1  GENERAL 

Terms  such  as  bias3,  precision  error,  uncertainty,  standard  deviation,  NBS, 
traceability,  calibration,  and  degrees  of  freedom  and  the  statistical  concepts  and 
mathematical  procedures  to  be  employed  were  introduced  in  Section  I.  This  section  will 
describe  the  mathematical  model  with  words,  illustrations,  and  an  example. 

It  is  intended  that  the  examples  given  will  closely  fit  typical  applications.  However, 
the  model  is  general,  and  if  specific  calibration  hierarchies  are  more  or  less  extensive  than 
the  examples,  simply  add  or  omit  levels  and  apply  the  model  as  shown;  if  specific 
measurement  systems  are  different  from  the  examples,  substitute  the  bias  limit  and 
precision  index  terms  for  the  system  components  and  apply  the  model. 

To  review  briefly,  there  are  two  types  of  measurement  error:  precision  and  bias. 
Precision  error  is  the  variation  of  repeated  measurements  of  the  same  quantity.  The 
sample  standard  deviation  (S)  is  used  as  an  index  of  the  precision.  Bias  is  the  difference 
between  the  true  value  and  the  average  of  many  repeated  measurements.  A  limit  (B)  for 
the  bias  is  estimated  based  on  judgment,  experience,  and  testing.  The  formula  for 
combining  these  into  uncertainty  (U)  is 

U  =  ±(B  +  t95S)  (II-l) 


or 

IT  =  B"  -  t95SandU+  =  B+  +  t95S 
when  nonsymmetrical  biases  are  present. 

Note  that  throughout  this  Handbook  lower  case  notation  always  indicates  elemental 
errors,  i.e.,  s  and  b  for  elemental  precision  and  bias,  and  upper  case  notation  indicates  the 
root-sum'-square  (RSS)  combination  of  several  errors,  e.g., 

S  =  ±y]  sj2  +  S22  +  s32 

B  =  ± ^  tq2  +  B22  +  b32 

where 

S2  =  Sj 

b2  =  ±vx7b7 


3For  a  definition  of  terms  used  in  this  Handbook,  see  the  Glossary  in  Section  IX. 
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The  remainder  of  this  section  is  devoted  to  illustration  of  a  typical  measurement 
uncertainty  analysis  and  the  propagation  of  errors  to  performance  parameters. 

2.2  MEASUREMENT  ERROR  SOURCES 

For  purposes  of  illustration,  the  elemental  error  sources  for  the  force  measurement 
system  will  be  treated  in  this  section.  These  error  sources  fall  into  three  categories: 

1.  Calibration  Hierarchy  Errors  (2.2.1) 

2.  Data  Acquisition  Errors  (2.2.2) 

3.  Data  Reduction  Errors  (2.2.3) 

Elemental  error  sources  for  other  measurements  will  be  enumerated  in  the  section 
dealing  with  each  measurement. 

2.2.1  Calibration  Hierarchy  Errors 

To  demonstrate  traceability  of  measurements  to  the  NBS,  whose  standards  are  by 
definition  the  “truth,”  it  is  necessary  to  establish  calibration  hierarchies.  Each  level  in  the 
hierarchy,  including  NBS,  constitutes  an  error  source  which  contributes  to  the  error  in 
the  final  measurement.  Calibration  of  all  measurement  instruments  at  the  NB$  is  possible; 


Fig.  11-1  Force  Measurement  Calibration  Hierarchy 


however,  such  calibrations  would  be  inconvenient,  time  consuming,  and  very  expensive. 
The  purpose  here  is  to  illustrate  a  typical  hierarchy  and  to  enumerate  the  error  sources 

within.  Figure  II- 1  is  a  typical  force 
transducer  calibration  hierarchy.  Associated 
with  each  comparison  in  the  calibration 
hierarchy  is  a  pair  of  elemental  errors.  These 
errors  are  the  unknown  bias  and  the 
precision  index  in  each  process.  Note  that 
these  elemental  errors  are  independent,  e.g., 
b2i  is  not  a  function  of  bn.  The  error 
sources  are  listed  in  Table  V. 


Table  V  Calibration  Hierarchy  Error  Sources 


Calibration 

Bias 

Limit 

Precision 

Index 

Degrees  of 
Freedom 

NBS  -  ILS 

bu 

sil 

dfll 

ILS-TS 

b21 

S21 

df2l 

TS-WS 

b31 

S31 

df3l 

WS-MI 

b41 

S4i 

df4i 
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2.2.2  Data  Acquisition  Errors 

Data  are  acquired  by  measuring  the  electrical  output  resulting  from  force  applied  to 
a  strain-gage-type  force  measurement  instrument.  Figure  II-2  illustrates  some  of  the  error 
sources  associated  with  data  acquisition.  Other  error  sources  such  as  electrical  simulation, 
thrust  bed  mechanics,  and  environmental  effects  are  also  present.  The  best  method  to 
determine  the  effects  of  all  of  these  error  sources  is  to  perform  end-to-end  calibrations 
and  compare  known  applied  forces  with  measured  values.  However,  it  is  not  always 
possible  or  even  desirable  to  do  this,  and  if  this  is  the  case,  it  is  necessary  to  evaluate 
each  of  the  elemental  errors  and  combine  them  to  determine  the  overall  error. 


Fig.  11-2  Data  Acquisition  System 


All  the  data  acquisition  error  sources  are  listed  in  Table  VI.  Symbols  for  the 
elemental  bias  and  precision  errors  and  for  the  degrees  of  freedom  are  shown. 


2.2.3  Data  Reduction  Errors 

Computers  operate  on  raw  data 
to  produce  output  in  engineering 
units.  The  errors  in  this  process  stem 
from  calibration  curve  Fits  (Fig.  II-3) 
and  computer  resolution. 

Symbols  for  the  data  reduction 
error  sources  are  listed  in  Table  VII. 
These  errors  are  often  negligible  in 
each  process. 


Fig.  11-3  Calibration  Curve 


Table  VI  Data  Acquisition  Error  Sources 


Error  Source 

Bias 

Limit 

Precision 

Index 

Degrees  of 
Freedom 

Excitation  Voltage 

b12 

s12 

df  1 2 

Electrical  Simulation 

b22 

s22 

df22 

Signal  Conditioning 

b32 

s32 

df32 

Recording  Device 

b42 

s42 

df42 

Force  Transducer 

b52 

s52 

df52 

Thrust  Bed  Mechanics 

b62 

s62 

df62 

Environmental  Effects 

b72 

s72 

df72 

Table  VII  Data  Reduction  Error  Sources 


Bias 

Precision 

Degrees  of 

Error  Source 

Limit 

Index 

Freedom 

Calibration  Curve  Fit 

bl  3 

si  3 

df  1 3 

Computer  Resolution 

b23 

s23 

df23 
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2.3  MEASUREMENT  UNCERTAINTY  MODEL 

The  measurement  process,  defined  for  an  entire  engine  test  facility,  is  the  totality  of 
all  the  individual  subprocesses  and  steps  in  the  measurement  system  for  a  given  engine 
type.  That  is,  the  process  is  the  total  of  all  the  calibrations,  all  data  acquisitions  and  all 
data  reductions.  Therefore,  the  precision  error  in  each  step  of  each  sub  process  is  reflected 
as  a  precision  error  in  the  total  process.  The  bias  error  in  each  subprocess  is  a  bias  error 
in  the  total  process.  (Another  definition  for  the  measurement  process  is  discussed  in 
Section  VIII). 

The  precision  index  (S)  at  any  stage  in  the  total  process  is  the  root-sum-square  of 
the  elemental  precision  indices  for  that  stage  with  the  elemental  precision  indices  for  all 
of  the  preceding  steps. 


(H-2) 


where  j  defines  the  subprocesses  calibration,  data  acquisition,  and  data  recording  and  i 
defines  the  steps  within  the  subprocess. 

For  example:  The  precision  index  for  the  calibration  process  is  the  root-sum-square 
of  the  elemental  precision  indices  of  Table  V. 

Scai  =  ±^S112  +  s212'  +  s312  +  S412  (H"3) 

The  precision  index  for  the  data  acquisition  process  is  the  root-sum-square  of  the 
precision  indices  of  Table  VI. 


^Data  “  ±\  s122  +  s222  +  s322  +  s422  +  s522  +  s622  +  s722  (IF4) 

Acquisition 

The  precision  index  for  the  data  reduction  process  is  the  root-sum-square  of  the 
precision  indices  of  Table  VII. 

SData  “  ±\fs132  +  s232  (II-5) 

Reduction 


The  force  measurement  precision  index  is  the  root-sum-square  of  all  the  elemental 
precision  indices  in  the  force  measurement  system. 


3Force 


-T 


2  2  2 
3U  +  S21  +  S31  +  S 


41  +s12  +  s22  +  s32  +  s42  +  s52  +  s62  +  s72  +  s13  +  s23 


(H-6) 


The  bias  limit  for  any  stage  in  the  process  is  the  root-sum-square  of  the  elemental 
errors  in  the  preceding  steps  of  the  process. 
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For  example:  The  bias  limit  for  the  calibration  hierarchy  is 


BCal  =  W  bll2  +  b212  +  b312  +  b 


41 


The  bias  limit  for  the  data  acquisition  process  is 

Bn...  -  ±y[b 


Data 
Acquisition 


2|^  2iU  2ik  2ik  2i  k  2  +  b, 


12  +  ^22  +  ^32  +  ^42  +  ^52~  +  u62 


72 


The  bias  limit  for  the  data  reduction  process  is 

Bn„,„  =  b 


Data 
R  eduction 


2  ,  b  2 
13  +  °23 


(II-7) 


(II-8) 


(II-9) 


The  bias  limit  for  the  force  measurement  process  is 


®Force  =  ^  +  ^212  +  ^312  +  ^412  +  +  ^22*  +  ^322  +  +  ^522  +  ^622  +  ^72  +  ^13  +  ^23  (IT10) 

Biases  associated  with  force  measurement  are  equally  likely  in  either  the  plus  or 
minus  directions,  i.e.,  there  are  no  nonsymmetrical  bias  limit  estimates. 

The  degrees  of  freedom  (df)  associated  with  the  precision  index  at  any  step  in  the 
process  are  calculated  using  the  Welch-Satterthwaite  formula.  It  is  a  function  of  the  degrees 
of  freedom  and  magnitude  of  each  elemental  precision  index. 

For  example:  The  degrees  of  freedom  for  the  calibration  precision  index  (Seal)  is 
df  =  kJ 


[V  + 

S212  + 

S312  + 

4 

4 

4 

4 

S11 

S21 

S31 

S41 

_dfn  + 

df2X  + 

df31  + 

dV 

(II- 1 1) 


The  degrees  of  freedom  for  the  force  measurement  precision  index  is 


df 


.sll2  + 

■212+ 

S312  + 

■.,2  + 

°i22 

+  S222 

+  9322  + 

■-22+ 

S522  + 

»622* 

s722  + 

S132  + 

”222] 

2 

-  4 

Q  4 

4 

4 

4 

0  4 

a  4 

4 

4 

4 

4 

a  4 

4-1 

S11 

S21 

s3  1 

S41 

s12 

S22 

S32 

s42 

S5  2 

s62 

S72 

S1 3 

S23 

_dfn  + 

d*21  + 

df31  + 

d*4l  + 

df12 

+  df22 

df42  + 

df52  + 

df62  + 

df72  + 

df13  + 

df23 

(IM2) 


The  uncertainty  parameter  (U)  at  any  stage  is  the  sum  of  the  bias  limit  (B)  for  that  stage 
and  the  precision  limit  (tgsS).  The  precision  limit  (tqsS)  for  any  stage  is  the  precision 
index  (S)  for  that  stage  times  the  95th  percentile  of  the  student’s  “t”  distribution  (when 
the  degrees  of  freedom  are  greater  than  30,  2.0  is  used  for  the  “t”  value).  The 
uncertainty  parameter  (U)  defines  the  limits  of  the  measurement  error  that  might 
reasonably  be  expected  in  a  well-defined  measurement  process: 

U  =  ±(B  +  t95S)  (11-13) 
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Figure  II-4  illustrates  the  uncertainty  parameter  (U). 


2.4  EXAMPLE  OF  THE  MODEL 

Figure  II-5a  is  a  block  diagram  showing  the  overall  model  for  determining  the 
uncertainty  in  gas  turbine  engine  thrust  specific  fuel  consumption.  The  blocks  identify 
the  two  major  parameters:  net  thrust  and  fuel  flow.  The  dotted  lines  indicate  the 
calculation  of  uncertainty  for  each  parameter;  solid  lines  indicate  the  propagation  of  bias 
limits  and  precision  indices  to  the  bias  limit  and  precision  index  for  thrust  specific  fuel 
consumption  using  Taylor’s  series  methods.  Detailed  treatment  of  fuel  flow  measurement 
uncertainty  and  net  thrust  determination  uncertainty  is  contained  in  Sections  IV  and  VII, 
respectively. 

In  Fig.  II-5b,  it  is  seen  that  each  parameter  block  contains  three  general  types  of 
errors:  calibration  errors,  data  acquisition  errors,  and  data  reduction  errors.  These  are 
identified  by  Si,  S2,  and  S3,  respectively,  for  precision  indices  and  Bi,  B2,  and  B3, 
respectively,  for  bias  limits.  The  lines  within  each  parameter  indicate  the  calculation  of 
uncertainty  (Ui,  U2,  and  U3)  for  each  type  of  measurement.  Other  lines  indicate  the 
calculation  of  bias  limits  and  precision  indices  for  the  individual  parameters. 

The  final  figure  of  the  series  (Fig.  II-5c)  illustrates  the  fact  that  each  measurement  is 
made  up  of  several  elemental  sources  of  error.  Examples  of  these  are  tabulated  in  Tables 
V,  VI,  and  VII.  In  the  figure,  blocks  indicate  the  formulas  for  the  calculation  of  bias 
limits  and  precision  indices  at  each  level  in  the  measurement  process.  The  lines  point  out 
the  procedures  for  determining  bias  limit  (B),  precision  index  (S),  and  uncertainty  (U)  for 
each  process  in  the  measurement  chain  and  also  for  the  calculated  parameter,  thrust 
specific  fuel  consumption. 
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a.  General  View 


Bias  Uncertainty  Precision 

NET  THRUST 
(See  Section  VII) 


b.  Propagation  of  Errors 


Bias 


Uncertainty 
NET  THRUST 


Precision 


c.  Elemental  Errors 
Fig.  11-5  Overall  Uncertainty  Model 
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As  an  example,  the  uncertainty  in  the  thrust  specific  fuel  consumption  of  a  gas 
turbine  engine  will  be  calculated.  Test  conditions  are  that  the  engine  is  being  tested  on  an 
outdoor  sea-level  test  stand.  Assume  a  nominal  sea-level  thrust  specific  fuel  consumption 
of  1 .0  lbm/lbf-hr  and  10,000  lbf  and  10,000  lbm/hr  for  net  thrust  and  fuel  flow, 
respectively.  Detailed  treatment  of  the  errors  in  net  thrust  determination  may  be  found 
in  Section  3.3  for  sea-level  testing  which  applies  to  this  example.  Section  VII  details  the 
treatment  of  errors  in  net  thrust  determination  at  altitude  conditions.  For  simplicity, 
values  for  the  bias  and  precision  index  for  fuel  flow  have  been  assumed. 

2.4.1  Net  Thrust  Measurement 


It  is  assumed  that : 


1 .  The  net  thrust  bias  limit  is 


Bf  =  ±18.1  lbf 
fn 


2.  The  net  thrust  precision  index  is 

Sv  =  ±37.8  lbf 

r  N 


3.  The  net  thrust  nominal  level  =  10,000  lbf 


Then, 


4.  Net  thrust  uncertainty  is 


Up  =  ±(Bf  +  tqrSF  ),  tQe  =  2.00  because  df  >  30  for  Sp 
fN  *NyD1Ny;:>  rN 


Up  =  ±(18.1  +  2.00  x  37.8) 

r  N 


=  ±93.7  lbf 


2.4.2  Fuel  Flow  Measurement 


It  is  assumed  that : 


1.  The  fuel  flow  bias  limit  is 


B^  =  ±50  lb/hr 


2.  The  fuel  flow  precision  index  is 


SW{  =  ±50  lb/hr,  dfw  =  60 
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3.  The  fuel  flow  nominal  level  =  10,000  lb /hr 
Then, 

4.  Fuel  flow  uncertainty  is 

UWf  =  ±^BW  +  t95Sw f^’fc95  =  2.00  because  df  >  30  for  SW{ 
Uw  =  ±(50  +  2.00  x  50) 

=  ±150  lb/hr 

2.4.3  Thrust  Specific  Fuel  Consumption 

The  TSFC  bias  limit  is 


=  ±0.0053  lbm/lbf-hr 
The  TSFC  precision  index  is 


STSFC  ~  ± 


I 7 


x  50 


,000 

=  ±0.0063  lbm/lbf-hr 
The  TSFC  degree  of  freedom  is 


+ 


/  —10,000 
\10,0002 


X 
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When  the  degrees  of  freedom  for  each  source  of  error  are  greater  than  thirty,  the 
resultant  degrees  of  freedom  will  also  be  greater  than  thirty.  For  illustrative  purposes,  the 
calculation  of  degrees  of  freedom  are: 


df 


7  1  \2  /-lO.OOO  \2T 

=  _(l0>000  X  )  +  \1Q,0002  )_ 

(_i_  x  soY  *  37-8)  4 

VlO.OOO  /  -  \10,00(r  / 


60 


57 


=  110 

The  result  is  greater  than  thirty,  as  expected.  Therefore,  tgs  =2.00. 
The  TSFC  uncertainty  is 

UTSFC  =  ±^BTSFC  +  t95STSFC^ 

UTSFC  =  ±(0.0053  +  2.00  x  0.0063) 

=  ±0.018  lbm/lbf-hr 


2.5  SUMMARY 

The  statistical  concepts  and  mathematical  procedures  used  to  develop  the  models  are 
set  forth  in  Section  I. 

In  Section  II,  the  uncertainty  model  is  presented  in  mathematical,  graphical,  and 
block  diagram  form  with  a  numerical  example  of  how  the  model  is  to  be  used.  These 
methods  are  summarized  in  Fig.  II-6,  a  logic  decision  diagram.  However,  Sections  I  and  II 
by  no  means  provide  full  treatment  of  the  problem  of  determining  uncertainty  in  the  gas 
turbine  engine  performance  parameter,  thrust  specific  fuel  consumption.  Some  things 
which  have  not  been  treated  in  this  section  are: 

1 .  Multiple  measurements  (see  Appendix  III) 

2.  Evaluation  of  elemental  errors  (see  Sections  III  through  VII) 

3.  Signed  bias  (see  Section  I). 
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To  Estimate 


Use 


Formula 


Bias  Limit 


1.  Elemental  (b) 


(For  Treatment  of  Signed  Biases,  see  Section  1.3.2) 


Judgment  Supported  by 
Special  Test  Data 


Estimate  a  Reasonable  Limit 
for  Each  Bias  Error 


2.  Measurement 
Bias 


Estimated  Elementals 


■  vK 


3.  Performance 
Parameter 
Bias 


Measurement  Bias  and 
the  Propagation  of 
Error  (Taylor  Series) 


F  Denotes 
Performance 
Parameter 
Function 


Precision  Index 
1.  Elemental  s. 


Data  from  Multiple 
Measurements 


2  (X  -XV 
L  L 


V1 


df 


V1 


2.  Measurement 
Precision 
Index 


Calculated  Elementals 
and  Data 


sj 


fsi- 


df  =  — 


fsi 


,12 


3.  Performance 
Parameter 
Precision 
Index 


Measurement  Precision 
Indices  and  the  Prop¬ 
agation  of  Error 
(Taylor  Series) 


tg5  Value 


Degrees  of  Freedom 
Less  Than  30  (df  <  30) 

Degrees  of  Freedom 
Greater  Than  or  Equal 
to  30  (df  >  30) 


Interpolate  in  Two-Tailed 
Student's  "t"  Table  for  t 

Use  t  =  2.0 


Uncertainty 
1.  Elemental 


Elemental  Bias  Limit 
and  Precision  Index 


°i  -  i*! +  *95*1] 


2.  Measurement 


Measurement  Bias 
Limi.ts  and  Precision 
Indices 


Dj  ‘  ±[BJ  +  ‘SSSj] 


3.  Performance 
Parameter 


Performance  Parameter 
Bias  Limit  and 
Precision  Index 


UF  ”  ±[BF  +  *95^] 


Fig.  11-6  Logic  Decision  Diagram 
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SECTION  III 

FORCE  MEASUREMENT 

3.1  GENERAL 

The  purpose  of  this  section  is  to  illustrate  the  measurement  uncertainty4  model  as 
applied  to  a  typical  force  measuring  system.  Figure  III- 1  illustrates  the  system  and  will  be 
the  basis  for  all  examples  in  this  section.  The  propagation  of  force  measurement  and 
other  parameter  measurement  uncertainties  to  obtain  net  thrust  uncertainty  are  discussed 
in  Section  VII. 


Fig.  1 1 1-1  Force  Measurement  System 


4For  a  definition  of  terms  used  in  this  handbook,  see  the  Glossary  in  Section  IX. 
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3.2  FORCE  MEASUREMENT  ERROR  SOURCES 

Error  sources  for  any  measurement  fall  into  three  categories:  (1)  calibration,  (2) 
data  acquisition,  and  (3)  data  reduction.  These  categories  will  be  discussed  in  this  order 
describing  methods  for  determining  values  for  the  elemental  errors. 

3.2.1  Force  Transducer  Calibration  Hierarchy 

Figure  III-2  illustrates  a  typical  force  transducer  calibration  hierarchy. 


Fig.  1 1 1-2  Force  Transducer  Calibration  Hierarchy 


Associated  with  each  comparison  in  the  calibration  hierarchy  is  a  pair  of  elemental 
errors..  These  errors  are  the  unknown  bias  and  the  precision  index  in  each  process.  Note 


that  these  elemental  errors  are  not  cumu¬ 
lative,  e.g.,  b2i  is  not  a  function  of  bn. 
The  error  sources  are  listed  in  Table  VIII. 

The  bias  limit  for  the  calibration 
process  is  the  root-sum-square  of  the  elemen¬ 
tal  errors  in  the  preceding  steps  of  the 
process. 

Bj  =  ±>Kl2  +  b212  +  b31S  +  b41’  (III-l ) 


Table  VIII  Calibration  Hierarchy  Error  Sources 


Calibration 

Bias 

Limit 

Precision 

Index 

Degrees  of 
Freedom 

ms  -  ILS 

bn 

sil 

dfn 

ILS-TS 

b21 

S21 

df2l 

TS-WS 

b31 

S31 

df3l 

WS-MT 

b4i 

S4i 

df4i 

The  precision  index  for  .the  calibration  process  is  the  root-sum-square  of  the 
elemental  precision  indices  in  the  preceding  steps  of  the  process. 


*  VT? 


321 


s3l 


=  41 


(III-2) 


Calibrations  are  accomplished  by  applying  known  forces  to  the  instrument  being 
calibrated  and  recording  the  output.  The  output  may  be  inches  deflection,  millivolts, 
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pounds  force,  or  other  measurement  units.  Several  known  forces  (usually  eleven  or  more) 
are  applied  over  the  range  of  the  instrument  being  calibrated  as  indicated  in  Table  IX. 
The  forces  are  applied  first  going  up  scale  and  then  going  down  to  determine  the 
hysteresis  errors. 


Table  IX  Calibration  Data 


Applied  Force 
Levels,  F 

Calibration  One 

Calibration  Two 

Measured  Force 

Calculated  Force 
(From  Curve  Fit 
of  Cal  1  Data) 

Measured  Force 

Calculated  Force 
(From  Curve  Fit 
of  Cal  2  Data) 

Up 

Down 

Up 

Down 

0 

0.00 

0.20 

0.105 

0.00 

0.20 

0.11 

2 

1.00 

1.60 

1.30 

1.25 

1.50 

1.38 

4 

2.20 

3.10 

2.65 

2.50 

2.90 

2.70 

6 

3.75 

4.82 

4.29 

4.00 

4.60 

4.30 

8 

5.77 

6.77 

6.29 

5.90 

6.50 

6.20 

10 

9.30 

9.30 

9.30 

9.29 

The  data  from  Table  IX  are  plotted  in  Fig.  III-3.  The  calculated  values  are 
determined  from  a  polynomial  curve  fit  of  the  data.  All  four  curves  demonstrate  the 
nonlinearity  of  the  calibration  (exaggerated  for  this  example).  The  difference  between  the 
upscale  lines  and  the  downscale  lines  demonstrates  the  hysteresis  of  the  system.  Note  that 
the  contribution  to  overall  uncertainty  by  transducer  nonlinearity  and  hysteresis  can  be 
minimized  by  considering  system  performance  over  a  relatively  small  range  near  nominal. 


Fig.  1 1 1-3  Calibration  Curves 
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3.2. 1.1  Precision  Index 


A  least  squares  polynomial  curve  (Y)  is  fitted  to  the  calibration  data: 
Y  =  A0  +  AjF  +  A2F2  +  ...  +  AkFk 


(III-3) 


where  Y  =  calculated  force  with  F  pounds  force  applied 

k  =  degree  of  curve  fit,  i.e.,  largest  exponent  of  F 
A0  through  Ak  are  curve  coefficients. 


Figure  III-4  illustrates  a  plot  of  calibration  data  with  the  dashed  line  representing  a 


least  squares  polynomial  curve  fit.  The  Y 
value  is  the  force  calculated  from  the  curve  fit 
and  corresponding  to  the  applied  force  F  in 
Eq.  (III-3).  The  Yj  values  are  calculated  from 
curve  fits  of  previous  calibrations  establishing 
a  set  of  Yj,  j  =  1,  ...  N,  where  each  Yj 
represents  a  calibration  and  curve  fit.  The 
precision  index  at  any  particular  point  Fj  on 
the  curve  is  calculated  by 


where  Y  =  the  average  of  all  Yj  values  for  this  transducer  at  F* 

Si  =  the  precision  index  for  Y  with  Fi  pounds  force  applied 
N  =  the  number  of  calibrations  in  the  estimate 

Equation  (III-4)  yields  the  precision  index  for  any  value  of  Fi  for  any  number  of 
calibrations.  For  example,  Fig.  III-3  exhibits  the  data  from  two  calibrations  of  one 
device,  say  an  interlab  standard.  Table  IX  lists  calculated  values  of  Y  from  the  data  from 
both  calibrations.  At  Fi  =  4,  Y  =  2.675  and  the  Yj  values  are  2.65  and  2.70.  These  data 
along  with  Eq.  (III-4)  yield 


(2.65  -  2.675)2  +  (2.70  -  2.675)2 
Si  '  (2-1) 

s.  =  ±0.034 

Note  that  Eq.  (III-4)  yields  the  precision  index  for  each  value  of  Fi,  but  there  are  many 
values  of  Fi.  The  precision  index  for  a  given  Fi  value  will  apply  over  a  narrow  range  of  F, 
possibly  ±10  percent  of  full  scale  from  the  point  of  interest.  Generally,  it  should  not  be 
assumed  that  the  precision  index  for  80  percent  of  full  scale  is  the  same  as  that  for  10, 
20,  30  percent  and  so  on.  Equation  (III-4)  applies  in  all  of  these  cases,  but  the 
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differences  (Yj  -  Y)2  must  be  summed  for  the  different  values  of  Fj  and  the  largest 
reported  as  the  precision  index  for  the  calibration  process.  Equations  (III-3)  and  (III-4) 
and  all  of  the  rules  presented  above  will  apply  to  each  level  in  the  calibration  hierarchy. 
The  precision  index  for  the  complete  hierarchy  is  calculated  as  indicated  by  Eq.  (III-5): 

Si  =  ±^si2  (III-5) 

where  Si  =  calibration  hierarchy  precision  index 

Si  =  precision  index  for  the  individual  levels 
in  the  hierarchy 

3.2. 1.2  Degrees  of  Freedom 

The  degrees  of  freedom  (dfi)  associated  with  the  precision  index  (si)  is  one  less  than 
the  number  (N)  of  Y  observations  used  to  determine  the  precision  index: 

dfi  =  N-l  (HI-6) 

Degrees  of  freedom  (dfi)  may  be  calculated  at  each  level  in  the  calibration  hierarchy. 
When  the  precision  index  (Si)  is  calculated  for  the  complete  hierarchy,  also  calculate  dfi 
for  the  hierarchy  utilizing  the  Welch- Satterth waite  technique  (see  example  in  Section  2.3) 
if  any  of  the  degrees  of  freedom  are  less  than  30. 

3.2.1 .3  Bias 

The  bias  for  each  level  in  the  calibration  hierarchy  should  be  reported  as  plus  or 
minus  the  largest  unknown  fixed  error  expected.  At  the  first  level  in  the  hierarchy  (NBS 
versus  interlab  standard),  the  NBS  will  state  an  upper  limit  of  bias  for  the  deadweights, 


Largest  Largest 

Negative  Positive 


Measured  Force - - 

Fig.  111-5  Calibration  Hierarchy  Elemental  Bias 
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e.g.,  “the  errors  of  the  applied  loads  did  not  exceed  0.002  percent,”  quoted  for  the 
calibration  of  an  interlab  standard  with  a  60,000-lb  capacity.  This,  however,  is  only  the 
bias  in  the  applied  forces.  There  will  be  additional  biases  resulting  from  the  calibration 
process.  The  estimate  of  the  bias  limits  for  the  calibration  process  must  be  based  on 
careful  analysis  of  the  calibration  data  and  any  other  available  information  tempered  by 
engineering  judgment.  For  example,  the  data  from  an  extremely  large  calibration  history 
may  lead  to  a  bias  estimate  no  greater  than  that  reported  at  the  preceding  level  in  the 
hierarchy.  On  the  other  hand,  if  only  one  calibration  is  available  to  use  as  a  guide  to  the 
bias  estimate,  the  estimate  from  the  preceding  level  in  the  hierarchy  might  be  increased 
by  an  order  of  magnitude. 

When  bias  limits  (bi)  have  been  established  for  each  level  of  the  calibration 
hierarchy,  a  bias  limit  Bi  for  the  total  hierarchy  may  be  calculated,  i.e., 


Bj  = 


(HI-7) 


3.2. 1.4  Uncertainty 

Uncertainty  in  the  calibration  process  is  now  obtained  by  a  simple  combination  of 
the  precision  index  and  bias  limit  (see  example  in  Section  2.3). 


Measurement 


As  indicated  in  Fig.  III-6, 


Uj  -  ±(Bj  +  t95Sj) 


(HI-8) 
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where 

Ui 

=  calibration  hierarchy  uncertainty 

Bi 

=  calibration  hierarchy  bias  limit 

Si 

=  calibration  hierarchy  precision  index 

t?5 

=  95th  percentile  of  the  “Student’s”  t  distribution 
with  dfi  degrees  of  freedom 

3.2.2  Data  Acquisition  and  Reduction  Errors 


The  best  method  of  evaluating  the  net  effect  of  data  acquisition  and  reduction 
errors  is  to  periodically  perform  applied  load  tests.  These  tests  will  evaluate  all  data 
acquisition  and  reduction  errors  in¬ 
cluding  errors  due  to  force  transduc¬ 
er  temperature  variations,  fuel  line 
temperature  and  pressure  variations, 
fuel  flow  and  environmental  effects 
on  the  thrust  bed. 

All  data  acquisition  error 
sources  are  listed  in  Table  X.  Sym¬ 
bols  for  the  elemental  bias  and 
precision  errors  and  for  the  degrees 
of  freedom  are  also  shown. 


The  bias  limit  for  the  data 
acquisition  process  is 


B2  -  ±y  ^122  +  ^222  +  ^322  +  ^422  +  +  ^622  +  ^12^  (III-9) 

The  precision  index  for  the  data  acquisition  process  is 


^2  -  ±'^  s122  +  s222  +  s322  +  s422  +  s522  +  s622  +  s722  (III-10) 

The  computer  operates  on  the  raw  data  to  produce  output  in  engineering  units.  The 
errors  in  this  process  stem  from  the  calibration  curve  fits  and  the  computer  resolution. 

Symbols  for  the  data  reduction 
error  sources  are  listed  in  Table  XI. 

These  errors  are  often  negligible  in 
each  process. 


The  bias  limit  for  the  data 
reduction  process  is 

B3  =  ^  ha2  +  t232  OH-11) 


Table  XI  Data  Reduction  Error  Sources 


Bias 

Precision 

Degrees  of 

Error  Source 

Limit 

Index 

Freedom 

Calibration  Curve  Fit 

bi3 

s13 

dfi3 

Computer  Resolution 

b23 

^23 

df23 

Table  X  Data  Acquisition  Error  Sources 


Error  Source 

Bias 

Limit 

Precision 

Index 

Degrees  of 
Freedom 

Excitation  Voltage 

b12 

s12 

dfl2 

Electrical  Simulation 

b22 

s22 

df22 

Signal  Conditioning 

b32 

s32 

df32 

Recording  Device 

b42 

s42 

df42 

Force  Transducer 

b52 

s52 

df5  2 

Thrust  Bed  Mechanics 

b62 

s62 

df62 

Environmental  Effects 

b72 

s72 

df?2 
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The  precision  index  for  the  data  reduction  process  is 


(III-12) 


3.2.2. 1  Applied  Load  Tests 

Applied  load  tests  are  performed  as  follows: 

1.  Install  an  engine  in  the  test  stand. 

2.  Connect  all  service  lines  (fuel,  instrumentation,  water,  etc.)  and  other 
restraints  to  the  engine. 

3.  Perform  an  end-to-end  calibration  of  the  force  measurement  system  in  the 
usual  manner  (with  all  service  systems  operating  at  nominal  levels  if 
practical). 

4.  Evaluate  the  calibration  data  and  perform  a  curve  fit  according  to  normal 
procedures. 

5.  Perform  the  usual  pre-run  set-up  procedures  as  if  preparing  for  an  engine 
run.  Just  prior  to  an  engine  run  is  an  excellent  time  to  perform  an  applied 
load  test. 

6.  Apply  a  known  force  by  means  of  the  force  calibration  system  equal  to 
the  nominal  expected  when  the  engine  is  delivering  rated  thrust. 

7.  Record  digital  data  at  a  sampling  rate  and  for  a  period  which  is  normal  for 
steady-state  engine  conditions;  also,  record  the  applied  force  (X)  indicated 
by  the  standard. 

8.  Make  several  (ten  or  more)  recordings  as  defined  in  (7)  above. 

9.  Reduce  the  data  by  means  of  the  engine  data  reduction  program. 

10.  Regardless  of  the  number  of  measuring  devices  used  (multiple  bridge  load 
cells,  multiple  load  cells,  etc.),  calculate  multiple  sample  average  Ykj  for 
each  steady-state  recording.  The  average  of  the  ten  or  more  recordings  (Yj) 
for  the  jth  bridge  or  transducer  is 


M 

2Y 

9=1 


kj 


where  M  =  number  of  steady-state  recordings. 


(Ill- 13) 
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The  grand  average  Y  is  then  calculated  for  all  load  cells 


Y  = 


N 

2 

i=l 


Y. 


(III-14) 


where  N  =  number  of  bridges 


11.  This  grand  average  (Y)  represents  a  measurement  of  the  known  input.  The 
precision  index  (sj)  for  this  average  is  estimated  from  the  precision  error 
of  the  bridges  and/or  load  cells  (Sb): 


sb  =  - 


-  -  2 

2(Y.-  Y ) 
j=l  J 


(III-l  5) 


N-l 


The  estimate  of  is  Sb  divided  by  the  square  root  of  the  number  of 
bridges  (N): 


s  •  =  ±  —  =  ± 


Vn" 


N  _  _  2 

1  (Y.-  Y) 
j=l  J 

N(N-l) 


(III-l  6) 


12.  If  several  applied  load  tests  are  performed,  the  precision  index  of  the  data 
acquisition  and  reduction  process  is  calculated  by  pooling  the  estimates 
(si)  from  each  test: 


(III-l  7) 


where  K  tests  have  been  performed. 

13.  The  bias  limit  for  data  acquisition  and  reduction  may  be  estimated 
through  careful  analysis  of  ancillary  data  such  as  applied  load  test  histories 
tempered  by  the  judgment  of  the  most  knowledgeable  force  measurement 
engineer. 

Applied  load  tests  performed  in  the  preceding  manner  will  evaluate  the  net  effect  of 
the  following  error  sources: 

1.  Excitation  voltage 

2.  Electrical  calibration  of  the  data  recording  system 

3.  Analog  to  digital  conversion 
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4.  Stand  mechanics 

5.  Calibration  curve  fit 

6.  Computer  resolution 

Performance  of  additional  applied  load  tests  at  the  conclusion  of  engine  runs  will 
provide  evaluation  of  the  net  effects  of: 

1.  Environmental  effects  on  force  transducer 

2.  Effects  of  fuel  line  temperature  and  pressure  variations 

3.  Environmental  effects  on  the  thrust  bed 

Post-run  applied  load  tests  are  performed  immediately  after  engine  shutdown  as 
follows  : 

1 .  Ensure  that  fuel  lines  are  at  nominal  run  temperatures  and  pressures 

2.  If  practical,  flow  fuel  at  nominal  flow  rates 

3.  Ascertain  that  the  force  measurement  system  is  at  run  temperature 

4.  Apply  a  known  force  as  described  in  the  pre-run  applied  load  test 

5.  Record  test  data  as  described  in  pre-run  test  procedures 

6.  Record  an  electrical  calibration  of  the  data  recording  system  to  ensure  no 
change  since  the  pre-run  calibration 

7.  Reduce  data  as  described  in  pre-run  test  procedures 

8.  Calculate  precision  index  using  Eqs.  (III-15)  through  (III-17) 

9.  Estimate  bias  limit 
3.2.Z.2  Elemental  Error  Evaluation 

If  it  is  undesirable  or  impractical  to  perform  applied  load  tests  frequently,  the 
alternative  is  to  evaluate  individually  all  elemental  errors  and  combine  them  statistically. 
The  complete  list  of  data  acquisition  and  reduction  elemental  errors  is: 

1.  Stand  mechanics 

2.  Fuel  line  temperature  variations 
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3.  Fuel  line  pressure  variations 

4.  Force  transducer  temperature  variations 

5.  Excitation  voltage 

6.  Recording  system  electrical  calibration 

7.  Analog-to-digital  converter  nonlinearity  and  drift 

8.  Recording  system  resolution 

9.  Electrical  noise 

10.  Tare  evaluation  (thrust  stand  losses) 

1 1 .  Computer  resolution 

In  the  following  sections,  the  above  errors  are  discussed  in  enough  detail  to  evaluate  them 
and  combine  them  statistically. 

3.2.2.2.1  Stand  Mechanics 

Several  mechanical  features  of  the  thrust  stand  (Fig.  III-7)  must  be  considered  and 
their  effects  evaluated.  These  features  are: 

1.  Design  of  thrust  bed  support  system 

2.  Flexure  design 

3.  How  much  deflection  can  be  expected  in  the  thrust  bed  and  measurement 
linkage  when  a  force  equal  to  nominal  rated  thrust  is  applied  at  the 
point(s)  of  engine  support? 


Fig.  111-7  Gas  Turbine  Thrust  Measurement  System  Calibration  Configuration 
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4.  How  are  fuel  lines  supported? 

5.  How  are  fuel  lines  and  other  restraints  oriented  with  relation  to  the  axial 
force  vector? 

6.  What  is  the  effect  of  engine  and  instrumentation  weight  on  force 
measurement? 

Some  of  these  are  simply  considerations  to  be  made,  with  improvements  to  minimize  the 
effects  being  the  obvious  course  of  action.  Errors  caused  by  stand  mechanics  will  always 
exist  to  some  degree. 

If  in-place  calibrations  are  not  performed,  i.e.,  only  laboratory  calibrations  of  the 
force  measurement  transducers  are  performed,  then  applied  load  tests  are  required  to 
evaluate  errors  caused  by  stand  mechanics.  For  example,  if  applied  load  tests  are 
performed  with  and  without  the  weight  of  the  engine  and  instrumentation  on  the  thrust 
bed  and  the  load  cell  output  is  measured  by  means  of  a  laboratory  potentiometer  to 
eliminate  recording  system  errors,  then  the  difference  between  measured  force  and 
applied  force  with  no  engine  installed  is  the  error  due  to  thrust  bed  design.  The 
difference  between  measured  force  and  applied  force  with  an  engine  and  instrumentation 
installed  is  the  error  caused  by  test  stand  design  and  the  additional  weight.  If  several  tests 
of  this  nature  are  performed,  distributions  of  data  can  be  developed  and  handled 
statistically.  Figure  III-8  illustrates  data  distribution  Xi  without  the  engine  installed,  and 


Fig.  111-8  Precision  Errors 

data  distribution  X2  with  the  engine  installed.  The  precision  index  for  tests  without  the 
engine  installed  is 


si 


2(x.  -  Xj)2 


(N— 1) 


(III-18) 
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The  precision  index  for  tests  with  the  engine  installed  is 


X(x.-x2)2 


N— 1 


where : 


X  =  applied  force 

si  =  precision  index  of  tests  without  engine  installed 

S2  =  precision  index  of  tests  with  engine  installed 

Xi  =  the  average  of  all  measured  values  without 
engine  installed 

X2  =  the  average  of  all  measured  value  with 
engine  installed 

N  =  number  of  tests  with  engine  installed  or 
without  engine  installed 


(III- 19) 


Unknown  bias  limit  estimates  may  be  made  as  indicated  in  Section  3. 2 .2.1,  item  13. 
Similar  tests  can  be  designed  to  evaluate  the  effect  of  other  error  sources  in  this  category. 


3.2.2.2.2  Fuel  Line  Temperature  Variations 

Variations  in  fuel  line  temperature  result  in  more  or  less  restraint  on  the  force 
measuring  system,  side  loads,  and  possible  axial  loads.  In-place  calibration  of  the 
measurement  load  cell  will  not  account  for  errors  from  this  source,  unless,  of  course,  run 
temperature  is  maintained  during  calibration.  Again,  applied  load  tests  are  the  best 
solution  with  data  being  evaluated  as  in  the  preceding  section  on  stand  mechanics.  If 
in-place  force  transducer  calibrations  are  performed,  with  the  engine  and  all  associated 
plumbing  installed,  errors  from  the  above  sources  will  be  reflected  as  nonlinearity  and 
hysteresis  in  the  calibration  data.  These  errors  then  become  a  part  of  the  error  attributed 
to  the  working  standard  versus  force  measurement  transducer  calibration  process. 
Calculation  of  the  precision  index  (Sj)  at  each  operating  point  F  is  accomplished  with  Eq. 

(III-4). 


=  ±1 


N  -  2 
X  (Y.  -  Y) 
j=l  3 

N— 1 


(III-4) 


where  Y  is  the  value  of  the  calibration  curve  at  the  operation  point  F,  and  the  N  values 
(Yj)  are  the  calculated  values  at  F  as  defined  in  Section  3. 2. 1.1  (Fig.  III-4).  The  degrees 
of  freedom  associated  with  Si  are  N-l. 


41 


AEDC-TR-73-5 


3.2.2.2.3  Fuel  Line  Pressure  Variations 

Side  loads  and  axial  loads  are  the  usual  result  of  pressurizing  fuel  lines.  Once  again, 
in-place  calibration  will  not  account  for  this  error  unless  the  lines  are  pressurized  during 
the  calibration.  Applied  load  tests  will  aid  in  evaluating  this  error.  Data  should  be 
evaluated  as  discussed  in  Section  3.2.2.2.I. 

3.2.2.2.4  Force  Transducer  Temperature  and  Ambient  Pressure  Variations 


3.2.2.2.4.1  Temperature  Variations 


The  best  method  for  minimizing  the  effect  of  temperature  variations  is  to  minimize 
the  variations  through  environmental  control.  This,  however,  is  not  always  possible. 
Another  way  to  combat  this  problem  is  to  perform  applied  load  tests  in  the  laboratory  at 
different  fixed  temperatures  on  individual  load  cells.  Suppose  a  load  cell  is  loaded  to  X 
pounds,  Wi  times,  at  a  constant  temperature  of  75° F,  and  the  average  of  the  N 
observations  is  Xi.  The  precision  index  and  the  bias,  which  is  correctable,  may  be 
established  as  follows: 


(III-20) 


where  sli  =  precision  index  for  the  load  cell 

Xj  =  force  indicated  by  the  load  cell 

Now,  if  the  same  load  X  is  applied.,  N2  times,  at  a  constant  temperature  of  40° F  and  the 
average  of  the  N2  observations  is  X2,  then 


N  2 

s^x.-x/  (III-22) 


bL2>X2-X  O”-23) 

where  SL2  “  precision  index,  for  the  load  cell 

Xi  =  force  indicated  by  the  load  cell 

To  be  conservative,  the  largest  of  the  two  precision  errors  (sli  and  SL2)  is  selected  as  the 
elemental  error  for  this  source.  This  will  minimize  the  possibility  that  changes  in 
conditions  will  invalidate  the  estimated  uncertainty  value.  A  relatively  large  change  in  bias 
and  very  little  change  in  precision  error  is  expected  (Fig.  III-9). 
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In  evaluating  the  effect  of  temperature  variations  on  load  cells,  it  is  very  important 
to  determine  the  temperature  of  the  strain-gage  bridge  both  in  the  laboratory  and  in  the 
test  environment.  Large  temperature  gradients  between  the  outer  shell  and  inner  working 
parts  of  a  load  cell  may  well  result  in  serious  errors  in  correction  values. 


Indicated  Force 


Fig.  1 1 1-9  Temperature  Bias  Effect  on  Distributions  of  Errors 
3.2.2.2A2  Ambient  Pressure  Variations 

When  used  in  altitude  test  chambers,  load  cells  may  be  exposed  to  a  range  of 
ambient  pressure  levels  from  approximately  14.7  (one  atmosphere)  to  about  0.5  psia.  A 
typical  variation  of  load  cell  output 
versus  ambient  pressure  is  shown  in  Fig. 

Ill- 10.  The  sensitivity  of  the  load  cell  to  4X 
ambient  pressure  is,  of  course,  a  func-  .5 
tion  of  the  load  cell  physical  characteris-  sc  3X 
tics.  Some  load  cells  are  compensated  to  g  « 
nullify  partially  the  effects  of  ambient  2x 
pressure  variation.  Typically,  load  cells  ug 
exhibit  an  increasing  output  in  the  «  x 
tension  direction  with  decreasing  ambi-  J 
ent  pressure.  Data  reduction  programs  0 
must  correct  for  load  cell  ambient  At.osph«e  At.oiph.re  At.osjh.re 

pressure  effects  to  remove  this  bias  error  Ambient  Pressure 

from  the  data.  The  data  reduction 

program  typically  makes  this  correction  Fig.  111-10  Ambient  Pressure  Effect  on 
based  on  a  measurement  of  the  load  cell  Load  Cell  Output 

environmental  pressure  during  altitude 

testing.  * 

To  determine  the  load  cell  sensitivity  to  ambient  pressure,  laboratory  tests  are 
performed  with  the  load  cell  in  a  “bell  jar.”  The  pressure  within  the  “bell  Jar”  is 
adjusted  over  the  desired  range,  and  load  cell  output  is  recorded  at  several  discrete 
pressure  levels.  Each  discrete  pressure  level  is  maintained  for  several  minutes,  and  the  load 
cell  output  is  monitored  to  detect  any  significant  pressure  leaks  in  the  load  cell. 
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The  elemental  errors  associated  with  the  load  cell  ambient  pressure  calibration,  the 
environmental  pressure  parameter  measurement,  and  data  reduction  must  be  considered  in 
determining  the  force  measurement  uncertainty. 

3.2.2.2.B  Excitation  Voltage  Errors 

Instrumentation  excitation  power  supplies  are  usually  purchased  with  rigid 
requirements  on  output  voltage  drift  and  regulation.  If  verification  limits  for  excitation 
voltage  are  established,  say  ±0.05  percent  of  the  output,  and  then  laboratory  tests  are 
performed  to  ensure  that  the  power  supply  produces  the  desired  voltage  within  these 
limits;  then  the  precision  index  is 


si  =  ±0.0003  x  desired  voltage 


(III-24) 


and  the  bias  limit  is 


bj  =  ±0.0005  x  desired  voltage  (III-25) 

where  si  is  the  calculated  precision  assuming  a  uniform  distribution  over  the  interval 
±0.0005.  Uniform  is  a  conservative  assumption  for  the  errors.  They  probably  will  have  a 
central  tendency. 


For  any  uniform  interval,  the  precision  index  is  calculated  by  taking  the  square  root 
of  the  upper  limit  minus  the  lower  limit  squared  divided  by  12: 


V 


(Upper  -  Lower)' 
12 


(III-26) 


(See  Appendix  A  for  the  derivation.) 

Better  estimates  of  the  elemental  bias  and  precision  errors  can  be  obtained  by 
measuring  the  excitation  voltage  during  a  run.  This  can  be  done  by  randomly  selecting  a 
channel  to  be  reserved  to  measure  the  voltage  during  the  run.  The  uncertainty  limit 
depends  on  the  frequency  of  error  variation  in  terms  of  test  duration.  The  error  could  be 
largely  precision  (Fig.  III-lla)  and  may  be  long  term  (drift)  and/or  short  term  (noise). 

The  error  could  be  mostly  bias  (Fig.  Ill-lib)  with  very  little  precision  error  (this 
could  be  long  term  drift  which  appears  as  bias  during  any  one  test).  Another  possibility  is 
that  the  system  could  contain  both  bias  and  precision  error  (Fig.  III-llc).  The  estimates 
from  the  recorded  data  would  be 


S:  = 


N - 

2(x.~  x) 
i=i  1 
N-l 


(III-27) 


and  b.  >  ±  |  desired  voltage  -  X|  (III-28) 

where  X  =  the  average  value  recorded  during  the  run. 


44 


AEDC-TR-73-5 


3.2.2.2.6  Recording  System  Electrical  Calibration 

Recording  system  electrical  calibrations  for  force  measurements  are  performed  by 
applying  known  voltages  such  as  zero  and  full  scale  at  the  recording  system  input  to 
determine  system  sensitivity  to  load  cell  analog  voltages.  Another  method  of  electrical 
calibration  is  the  shunt  resistor  calibration.  This  method  employs  precision  resistors 
which,  by  means  of  switches,  are  placed  in  parallel  with  one  or  more  of  the  active  bridge 
legs  in  the  load  cell.  These  shunt  resistors  unbalance  the  load  cell  bridge  and  cause  a 
resultant  voltage  output. 

Errors  associated  with  voltage  calibration  are: 


Precision  Index  Bias 

1.  Calibration  power  supply  sp  bp 

2.  Analog  to  digital  conversion  ) 

>  sk  bk 

3.  System  resolution  j 

Calibration  power  supply  errors  sp  and  bp  are  evaluated  by  the  same  procedure  employed 
for  excitation  power  supplies  (see  Section  3. 2. 2.2. 5). 

The  net  effect  of  errors  from  the  other  two  sources  can  be  evaluated  by  measuring 
the  voltage  output  of  the  calibration  power  supply  with  a  laboratory  standard  and  the 
recording  system.  If  this  test  is  performed  a  number  of  times,  a  distribution  can  be 
developed  similar  to  the  one  shown  in  Fig.  III-12. 

The  precision  index  (sk )  is 


where 


= 


—  2 

2(x.  -  x) 

j=i  J 


N-l 


Xj  =  voltage  indicated  by  the  recording  system 
X  =  average  of  all  recording  system  indications 
N  =  number  of  observations  of  Xj 
X  =  voltage  indicated  by  the  laboratory  standard 


(III-29) 


The  electrical  calibration  precision  index  (sj)  is 

-  W-p2  -  sk2  (III-30> 

Estimating  limits  for  the  unknown  biases  bp  and  bk  are  left  to  the  judgment  of  the  most 
knowledgeable  engineer.  Of  course,  this  judgment  should  be  supported  by  an  extensive 
history  of  special  tests  designed  for  this  specific  purpose. 
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In  the  case  of  shunt  resistor 
calibration,  recording  system  sensitivity 
is  determined  in  terms  of  pounds  per 
digital  count.  This  is  accomplished  by 
recording  the  count  level  at  some 
reference  force  level  (for  example,  zero 
applied  force)  and  then  recording  the 
count  level  with  the  resistor  shunted 
across  the  bridge.  The  force  equivalent 
of  the  bridge  unbalance  caused  by  the 
shunted  resistor  is  known.  Therefore, 
the  change  in  recording  system  counts 
corresponding  to  this  force  change 


Fig.  111-12  Elemental  Precision  Error  of 
Calibration  Power  Supply 


determines  system  sensitivity  (pounds  per  count).  The  errors  associated  with  this 
technique  are 


Precision  Index  Bias 


1.  Erroneous  Shunt  Resistance  Values  ---  bs 

2.  Line  Resistance  —  br 

3.  Reference  Errors  sp  bp 


Analog-to-digital  conversion  and  system  resolution  errors  may  be  evaluated  by  the 
technique  described  below.  The  reference  errors  (sp  and  bp)  are  evaluated  by  pre-  and 
post-run  tare  investigations.  The  total  effect  of  the  first  two  error  sources  may  be 
evaluated  as  follows: 

1  .•  Install  a  force  transducer  and  connect  to  the  recording  system 

2.  Install  a  force  standard  in  the  system  such  that  it  senses  the  same  force  as 
the  measurement  transducer 

3.  Switch  in  the  shunt  resistor  and  make  a  multiple  scan  (ten  or  more) 
recordings  (Yj) 

4.  Apply  a  force  equivalent  to  the  shunt  resistor  as  indicated  by  the  force 
standard  and  established  by  calibration 

5.  Make  a  multiple  scan  (ten  or  more)  recording  (Yk) 

6.  Repeat  steps  3,  4,  and  5  several  times,  say  ten 

7.  Calculate  a  multiple  scan  average  Yi  and  Yk  for  steps  3  and  5,  respectively 

8.  Further  calculate  a  Y\  and  Yk  for  the  repeated  recordings 
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The  difference  Yi  -  Yk  is  correctable.  Estimates  of  the  limits  of  the  unknown  bias  from 
these  sources  are  left  to  engineering  judgment  supported  by  special  test  data. 

S.2.2.2.7  Analog-To-Digital  Conversion  Errors 

This  portion  of  the  data  acquisition  system 
includes  amplifier  and  analog-to-digital  (A/D) 
converter.  Consider  these  two  components  as  a  single 
unit,  first  because  modem  data  recording  systems 
employ  only  one  amplifier  which  is  a  part  of  the  A/D 
converter,  and  secondly,  because  the  errors  are  more 
easily  evaluated. 


Analog-to-digital  conversion  error  is  evaluated 
by  the  following  procedure  : 

1 .  Select  a  stable  voltage  source  and  a  voltage  standard 

2.  Connect  the  voltage  source  to  the  A/D  converter  such  that  it  is  common 
to  several  channels 

3.  Connect  the  voltage  standard  into  the  system  such  that  it  will  have  no 
effect  on  the  recorded  data 

4.  Make  a  multiple  scan  (ten  or  more)  recording  with  the  input  to  all 
channels  shorted,  i.e.,  with  the  input  voltage  equal  to  zero 

5.  Make  a  multiple  scan  (ten  or  more)  recordings  with  the  input  at  a  level 
which  will  produce  a  digital  indication  slightly  less  than  full  scale 

6.  The  data  from  4  and  5  above  will  allow  calculation  of  the  sensitivity  (Fig. 
III-13)  of  each  channel  to  applied  voltages.  For  example: 

„  ...  /counts\  digital  output  (counts) 

Sensitlvlty  (__) g f—fc-as, —  «ii-3  i ) 

7.  Apply  discrete  voltages  (typically  eleven  or  more)  in  ascending  and 
descending  steps  to  the  A/D  conversion  unit  input  and  make  multiple  scan 
(typically  ten  or  more)  recordings  at  each  level 

8.  Repeat  7  several  times  over  a  period  of  several  hours  (typically  four  or 
more).  Calculate  a  multiple  scan  average  (Yy  counts)  for  each  channel  at 
each  voltage  level.  The  average  (Yj)  for  each  voltage  level  and  for  each 
channel  is 


Fig.  111-13  Sensitivity  Curve 


Yi  - 


M 

X 

i=l 


Y.. 


(III-32) 
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where  M  =  number  of  multiple  scan  averages  at  each  voltage  level  for  each 
channel.  The  grand  average  (Y)  at  each  voltage  level  is  then  calculated  for  all 
channels 


N  _ 

£,YJ  (HI-33) 

N 

where  N  =  number  of  channels.  The  precision  index  for  A/D  conversion  is  the 
within  channel  variation  pooled  for  the  N  channels: 


9  A/D 


N  Mi 

£  X(Y.-Y)2 

j=l  i=l  1J  J 


N 

£(m.  -  l) 

j=i  1 


(III-34) 


For  an  actual  engine  measurement,  this  precision  index  must  be  converted  to  the 
standard  error  of  the  mean  by  dividing  by  the  square  root  of  the  number  of  recordings 
used: 


S 


mean 


SA/D 

y/T 


(III-35) 


where  K  recordings  are  used  for  each  measurement.  This  test  will  yield  a  conservative 
estimate  of  the  precision  index  because  the  precision  index  in  the  voltage  standard  will 
influence  the  data. 


3.2.2.2.8  Recording  System  Resolution 

This  is  primarily  a  fixed  error  in  that  for  digital  systems  the  resolution  error  is  plus 
or  minus  one-half  of  one  count.  Whether  the  system  is  three  digit  or  four  digit,  the  error 
is  still  one-half  of  one  count.  What  really  happens  is  that,  if  a  system  is  between  digits, 
e.g.,  5000.5,  the  indicator  lights  will  alternate  between  5000  and  5001.  If  ten  recordings 
are  made,  the  average  will  likely  be  5000.5.  However,  suppose  the  system  indicates  a 
constant  digital  value  of  5001  for  an  analog  input  equal  to  5000.6.  Nothing  has  been 
gained  from  multiple  sampling  and  averaging  in  this  case.  The  precision  index  for 
recording  system  resolution  is 


Sj  =  ±0.3  units 


and  the  bias  limit  is  zero. 

3.2. 2.2.9  Electrical  Noise 

Electrical  noise  is  an  error  which  is  generally  purely  random.  The  effect  can  best  be 
described  as  a  variable  indication  of  an  input  which  is  constant.  The  effect  of  electrical 
noise  can  be  minimized  by  making  several  measurements  and  averaging.  Suppose  the 
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digital  indication  of  a  constant  5-volt  signal  varies  randomly  over  the  interval  from  4090 
to  5010.  If  ten  measurements  are  recorded  and  averaged,  the  answer  will  be  very  close  to 
5000.  The  precision  error  caused  by  electrical  noise  is 


(III-36) 


where 


Sj  =  electrical  noise  precision  index 
Yi  =  individual  recorded  values 
Y  =  the  average  of  all  measurements 
N  =  the  number  of  measurements 


3.2.2.2.10  Tare  Variations 


If  the  measurement  system  output  is  recorded  for  each  run  after  engine  shutdown, 
with  fuel  line  temperatures  and  pressures  at  run  conditions,  with  the  force  transducer  and 

thrust  bed  at  run  temperature  and  with  fuel 
flowing  at  nominal  rates  if  possible,  most  of 
the  bias  caused  by  these  conditions  will  be 
eliminated.  Tare  variation  history  on  any 
given  test  stand  should  yield  a  data 
distribution  similar  to  Fig.  III-14.  The 
precision  index  for  tare  is  then 


■4 


1  (X.-  X)2 
i=l  _ 

N— 1 


(III-37) 


Fig.  I  SI-14  Tare  History  Showing  Ele¬ 
mental  Precision  Error 


The  bias  limits  for  tare  measurement  are 
estimated  in  the  same  manner  as  the  bias 
limit  for  force  measurement. 


3.2.2.2.11  Computer  Resolution 


Computer  resolution  is  the  source  of  a  small  elemental  error.  Some  of  the  smallest 
computers  used  in  experimental  test  applications  have  six  digits  resolution.  The  resolution 
error  is  then  plus  or  minus  one  in  106.  Even  though  this  error  is  probably  negligible, 
some  consideration  should  be  given  to  it.  For  example,  consideration  should  be  given  to 
rounding-off  and  truncating  errors.  Examples  of  rounding-off  are 


10.4  is  rounded  off  to  10.0 
10.6  is  rounded  off  to  11.0 
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Rounding-off  results  in  a  precision  error.  Examples  of  truncating  are 

10.1  =  10.0 
10.9  =  10.0 

Truncating  always  results  in  a  bias.  Whenever  faced  with  the  choice  of  a  small  precision 
error  versus  a  small  bias,  the  precision  error  is  generally  chosen.  Therefore,  the  computer 
resolution  error  is 


Sj  =  ±0.3  digits  (see  Appendix  A  for  derivation) 

3.3  FORCE  MEASUREMENT  ERROR  ANALYSIS 

By  assuming  completely  hypothetical  numbers  for  the  elemental  error  terms  for  the 
calibration  hierarchy,  data  acquisition,  and  data  reduction  processes,  Table  XII  tabulates 
values  for  all  elemental  bias  and  precision  error  terms  as  defined  in  Tables  VIII,  X,  and 
XI.  Table  XII  also  includes  sample  sizes  for  the  calibration  processes. 


Table  XII  Force  Measurement  Elemental  Error  Values 


Calibration  Errors,  lb 

Data  Acquisition  Errors,  lb 

Data  Reduction  Errors,  lb 

Bias 

Precision 

Sample 

Size 

Bias 

Precision 

Bias 

Precision 

bn  =±0.2 

sn  =  ±10.0 

6 

b12=±5.0 

s12  =  ±5-0 

bi3  =±10.0 

si  3  =  negligible 

b21  =  ±0.2 

s2i  =  ±10.0 

11 

b22  =  ±5-0 

S22  =  ±5.0 

b23  =  negligible 

S23  =  negligible 

b3i  =  ±0.4 

S31  =  ±14.1 

5 

b32  =  ±5.0 

S32  =  ±5.0 

b41  =  ±0.8 

s4i  =  ±20.0 

17 

b42  =  ±5.0 

S42  =  ±5.0 

b52  =  ±0.4 

s52  =  ±20.0 

b62  =  ±10.0 

s62  =  ±10.0 

b72  =  ±5.0 

S72  =  ±5.0 

(df  =  31  for  all  elemental 

precision  errors) 

The  errors  associated  with  the  calibration  hierarchy,  data  acquisition,  and  data 
reduction  stages  in  the  measurement  process  are  calculated  below  and  are  identified  by 
Si ,  S2 ,  and  S3 ,  respectively,  for  precision  indices  and  Bi ,  B2 ,  and  B3 ,  respectively,  for 
bias  limits  and  Ui,  U2,  and  U3,  respectively,  for  uncertainty  intervals. 

1 .  Calibration  bias  limit  for  the  force  transducer  is 

B,  =  ±^fb? 

_ _  (III-38) 

Bj  =  ±y  (0.2) 2  +  (0.2)2  +  (0.4) 2  +  (0.8) 2 

Bj  =  ±0.94  lb 
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2. 


Calibration  precision  index  estimate  for  the  force  transducer  is 

si  - 

_  (III-39) 

Sj  =  (10)2  +  (10)2  +  (14. 1) 2  +  (20) 2 


S1  =  ±28.3  lb 


3.  To  demonstrate  use  of  the  Welch-Satterthwaite  method  for 
determining  degrees  of  freedom  (df),  small  sample  sizes  for  the 
calibration  processes  in  the  force  transducer  calibration  hierarchy 
have  been  assumed.  Sample  sizes  are  included  along  with  the 
elemental  errors  in  Table  XII.  From  Section  I, 


df  = 


(III-40) 


where  dfn  =  sample  size  minus  one  for  the  nth  calibration 

2 

,,  [(10)2  +  (10)2  +  (14. 1)2  +  (20)2] 
df  j  =  - 

(10)4  UO)4  (14. 1)4  ( 20) 4 

5  +  10  •+  4  +  16 

640  X  103 
23  x  103 

=  27.8 


Under  the  “t”  column  in  Table  E-l  in  Appendix  E,  t  is  2.052  for  27 
degrees  of  freedom  and '  2.048  for  28  degrees  of  freedom. 
Interpolating  linearly  gives  a  t  of  2.049  for  27.8  degrees  of  freedom. 

The  calculation  of  calibration  uncertainty  (Ui)  for  the  force 
transducer  is  then 

Uj  =  ±(Bj  +  tg^Sj) 

=  ±(0.94  +  2.049  x  28.3)  (III-41) 

=  ±58.9  lb 
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4.  Data  acquisition  bias  limit  is 

b2  =  i^fbJ 

=  +-\/(5)2  +  (5) 2  +  (5) 2  +  (5) 2  +  (0.4) 2  +  (10) 2  +  (5) 2 
=  ±15.0  lb 

5.  Data  acquisition  precision  index  estimate  is 

=  ±yj(5)2  +  (5) 2  +  (5) 2  +  (5) 2  +  (20) 2  +  (10)2  +  (5)2 
=  ±25.0  lb 

6.  Data  acquisition  uncertainty  is 

U  2  =  ±(B2  +  t95S2) 

=  ±(15.0  +  2  x  25.0) 

=  65.0  lb 

tg (-  =  2.00  because  df  >  30  for  S2 

7.  Data  reduction  bias  limit  is 

B3  - 

=  ±10.0  lb 

8.  Data  reduction  precision  index  estimate  is 

s3  . 

=  0 

9.  Data  reduction  uncertainty  is 

Ug  =  ±(Bg  +  tpgSg) 

=  ±(10+0.0) 

=  ±10.0  lb 

t95  =  2.00  because  df  >  30  for  Sg 

1 0.  Force  measurement  bias  limit  is 

Bf  =  ±yj  B}2  +  B22  +  Bg2 

=  ±^(0.9)2  +  (15) 2  +  (10)2 
=  ±18.1  lb 


(III-42) 


(III-43) 


(III-44) 


(III-45) 


(IIM6) 


(III-47) 


(III48) 
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1 1 .  Force  measurement  precision  index  estimate  is 


sF  =  ± ^  Sj2  +  s22  +  s32 

=  ±-^|  (28. 3)2  +  (25) 2  +  02 
=  ±37.8  lb 


(III49) 


12.  Degrees  of  freedom  for  force  measurement  are 


dfp 


(Sx2  +  s22  +  s32)2 
dfx  df2  df8 


[(28. 3)2  +  ( 2  5 ) 2] 2 

(28. 3) 4  +  (25) 4 
27.8  31 

=  57 


(III-50) 


13.  Force  measurement  uncertainty  is 

Up  =  ±(Bp  +  tgj.Sp) 

=  ±(18.1  +  2.00  x  37.8)  dfF  =  57,  t95  =  2.00 

=  ±93.7  lb 


(III-51) 


3.4  END-TO-END  CALIBRATION 

A  working  standard  which  typically  consists  of  a  strain-gage  load  cell(s)  with  a 
precise  read-out  device  may  be  obtained.  The  working  standard  is  installed  in  the  force 
measurement  system  such  that  the  force  applied  to  the  measurement  system  will  also  be 
applied  to  the  working  standard  (Fig.  111-7).  All  electrical  and  mechanical  service 
connections  to  the  force  measuring  system  should  be  intact,  and  all  system  pressures 
should  be  adjusted  to  the  nominal  levels  incurred  during  engine  testing.  Care  must  be 
taken  to  ensure  that  those  fluid  systems  which  are  pressurized  but  not  flowing  during 
calibration,  especially  the  engine  fuel  system,  are  designed  so  that  no  fluid  moments 
forces  are  applied  to  the  thrust  stand  during  testing  with  fluid  flowing.  Calibration  is 
accomplished  by  applying  several  known  forces  in  succession  (usually  eleven  or  more)  to 
the  measurement  system  and  recording  the  results  on  a  digital  recording  system.  The  data 
recorded  are  pounds  of  applied  force  as  indicated  by  both  the  working  standard  and  the 
resulting  voltage  output  of  the  measurement  transducer.  Generally,  the  calibration  cycle 
will  be  repeated  one  or  more  times. 
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Typical  calibration  data  for  a  force  measuring  system  used  in  engine  sea-level  static 
testing  is  as  shown  in  Fig.  III-15.  During  the  course  of  sea-level  static  testing,  the  forces 
are  always  applied  in  one  direction  only. 


Typical  calibration  data  for  a  force  measuring  system  used  in  engine  altitude  testing 
is  as  shown  in  Fig.  Ill- 16.  During  the  course  of  altitude  testing,  the  resulting  forces 
experienced  may  be  either  “positive”  or  “negative”  depending  on  the  simulated  flight  and 
altitude  conditions. 


Fig.  111-15  Typical  Calibration  Data  from 
Force  Measuring  System  Used 
in  Engine  Sea-Level  Testing 


Fig.  111-16  Typical  Calibration  Data  from 
Force  Measuring  System  Used 
in  Engine  Altitude  Testing 


A  force  calibration  program  is  utilized  in  a  digital  computer  to  fit  a  least  squares 
curve  through  the  calibration  data  in  Figs.  Ill- 15  and  III-16.  The  curve-fit  produces 
coefficients  from  which  measured  force  may  be  determined.  In  practice,  curve-fits  are 
usually  linear  or  second  order.  Occasionally,  a  third-order  curve-fit  may  be  used  to 
represent  a  calibration.  Higher  order  curve-fits  should  not  be  used  without  close 
examination.  Without  a  keen  knowledge  of  the  relationship  between  data  and  a  higher 
order  curve-fit,  unrepresentative  values  may  result  at  interpolated  points. 


3.5  SUMMARY 


Errors  from  calibration,  data  acquisition  and  data  reduction  processes  must  be 
evaluated  by  one  of  two  methods: 

1.  Performance  of  end-to-end  calibrations  and  pre-  or  post-run  applied 
load  tests 

2.  Evaluation  of  all  elemental  errors 
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In  either  case,  the  evaluated  errors  are  combined  by  the  methods  outlined  in  Section 
3.3,  to  determine  the  precision  index  (Sp),  bias  (Bp),  and  uncertainty  (Up)  for 
measured  force. 


56 


AE  DC-TR-73-5 


SECTION  IV 

FUEL  FLOW  MEASUREMENT 


4.1  GENERAL 

Fuel  flow  measurements  are  difficult  because  there  is  no  standard  for  measuring 
volume  per  unit  of  time;  therefore,  the  flow  calibration5  must  be  referenced  to  standards 
for  weight  or  volume.  Furthermore,  there  is  no  universal  method  for  calibrating  a 
flowmeter. 

Turbine  meters  are  the  most  widely  used  instruments  for  measuring  fuel  flows.  They 
generate  an  alternating  voltage  with  frequency  proportional  to  the  volumetric  flow  rate. 
The  frequency  of  the  output  is  converted  to  an  analog  voltage  and  then  to  digital  counts. 
Another  method  for  recording  turbine  meter  signals  is  to  count  the  voltage  excursions 
(pulses)  over  some  preset  period  of  time  to  determine  the  signal  frequency.  Figure  IV- 1 
illustrates  a  typical  turbine  meter  signal. 


Time 


Fig.  IV-1  Turbine  Meter  Signal 
Turbine  meters  may  be  calibrated  by  three  methods: 

1.  Volumetric:  flowing  a  measured  volume  of  fluid  through  the  meter  to 
establish  a  pulses-per-gallon  factor, 

2.  Gravimetric:  flowing  a  measured  mass  of  fluid  through  the  meter, 
determining  the  density,  and  converting  the  mass  to  volume  to  establish  a 
pulses-per-gallon  factor,  and 

3.  Comparative  calibration:  comparing  the  meter  against  a  master  meter. 


5 For  a  definition  of  terms  used  in  this  Handbook,  see  the  Glossary  in  Section  IX. 
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Calibration  factors  are  determined  over  a  range  of  turbine  meter  frequencies  to 
develop  a  calibration  curve.  Figure  IV-2  is  an  illustration  of  a  typical  turbine  meter 
calibration  curve. 


Fig.  IV-2  Turbine  Meter  Calibration  Curve 


The  range  of  calibration  factors,  over  the  linear  range  of  a  turbine  meter,  is  typically 
±0.5  percent.  However,  meter  range  may  vary  somewhat  and  is  influenced  by  meter  size 
and  design,  plus  fluid  viscosity.  A  complete  analysis  of  turbine  meter  performance  is 
given  by  the  “Turbine  Flowmeter  Performance  Model.”  (AD825354)  prepared  by  the 
Greyrad  Corporation. 

Multiple  measurement  of  fuel  flow  is  recommended  for  several  reasons,  the  chief 
ones  being  reliability  and  accuracy.  Multiple  measurements  are  readily  accomplished  by 
simply  installing  two  or  more  turbine  meters  in  series.  The  meters  should  have 
independent  calibrations  as  far  back  in  the  calibration  hierarchy  as  possible. 

4.2  FUEL  FLOW  MEASUREMENT  ERROR  SOURCES 

Errors  in  fuel  flow  measurement  fall  into  three  major  categories:  (1)  calibration,  (2) 
data  acquisition,  and  (3)  data  reduction.  The  calibration  elemental  bias  and  precision 
error  sources  will  vary  according  to  the  method  of  calibration  used,  while  the  data 
acquisition  and  reduction  errors  will  not.  The  next  section  will  contain  three  parts,  one 
for  each  method  of  calibration.  All  three  may  not  apply  to  a  particular  test  facility.  The 
ones  that  do  not  should  be  ignored.  The  remainder  of  the  section  will  be  devoted  to 
discussions  of  the  elemental  errors  in  the  data  acquisition  and  data  reduction  processes. 

4.2.1  Calibration  Errors 

Turbine  meters  are  calibrated  by  three  methods  or  a  combination  thereof.  The  first 
is  volumetric  calibration.  It  is  accomplished  by  flowing  a  measured  volume  of  fluid 
through  the  meter  and  recording  the  total  number  of  turbine  meter  cycles  (pulses) 
generated.  The  calibration  factor  (K  factor)  is  then  calculated 

total  pulses  pulses  (IV-1) 

total  gallons  gallon 
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The  second  method,  gravimetric  calibration,  is  accomplished  by  flowing  a  measured 
mass  of  fluid  through  the  meter  and  again  recording  the  total  number  of  turbine  meter 
pulses.  Measurement  of  fluid  temperature  and  pressure  will  allow  determination  of  fluid 
density.  With  these  data,  a  meter  K  factor  may  be  calculated: 

£  total  pulses  pounds 
total  pounds  gallon 


pulses 

gallon 


(IV-2) 


where  density  =  pounds  per  gallon. 

The  third  method  is  comparative  calibration.  The  meter  being  calibrated  is  compared 
against  a  working  standard  turbine  meter.  In  some  applications  turbine  meters  are  so 
repeatable  that  the  greater  part  of  any  precision  error  incurred  results  from 
nonrepeatability  of  the  calibrating  device.  In  this  case,  better  calibration  results  can  be 
obtained  by  simply  flowing  the  calibration  fluid  through  a  standard  turbine  meter  in 
series  with  the  meter  being  calibrated.  Data  recorded  are  frequency  of  each  meter  and  the 
ratio  (R)  of  total  pulses  from  the  meter  being  calibrated  to  total  pulses  from  the  standard 
meter.  The  calibration  factor  (Kcai)  for  the  meter  being  calibrated  is 

pulses  _  ,, 

Cal  gallon  “  WRstandard  (IV-3) 


where  Kstan(iarti 


the 


pulses 

gallon 


factor  for  the  standard  meter  at  the  set  frequency. 


4.2. 1.1  Volumetric  Calibration 

At  the  apex  of  the  calibration  hierarchy,  Fig.  IV-3, 
for  volumetric  calibrations  is  the  National  Bureau  of 
Standards  Dynamic  Weigh  Calibrator.  The  Interlab 
Standard  Turbine  Meter  is  calibrated  against  this 
calibrator  and  in  turn  is  used  to  calibrate  the  working 
standard  volumetric  calibrator  in  the  company 
laboratory. 

4.2. 1.1.1  Calibration  of  the  Interlab  Standard 

Beginning  with  the  interlab  standard,  calibration 
methods  and  elemental  error  evaluation  techniques  at 
each  level  in  the  hierarchy  will  be  discussed. 

Turbine  meters  are  calibrated  at  the  NBS  as 
follows : 


Fig.  IV-3  Turbine  Meter 
Volumetric 
Calibration 
Hierarachy 
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1 .  At  each  pulse  frequency,  specified  by  the  owner,  and  controlled  to  within 
one-half  percent,  the  total  number  of  pulses  generated  are  counted  during 
the  period  required  to  flow  a  weighed  quantity  of  liquid  through  the 
meter. 

2.  Liquid  density  is  determined  using  measured  values  of  liquid  temperature 
and  pressure. 

3.  The  weighed  quantity  of  fluid  is  converted  to  gallons  using  the  density 
determined  in  step  (2). 

4.  A  pulses/gallon  (K)  factor  is  calculated  from  the  data  obtained  in  steps 
(1),  (2),  and  (3). 

5.  Steps  (1)  through  (4)  are  repeated  five  times  successively  on  each  of  two 
different  days  making  a  total  of  ten  (10)  separate  observations. 

The  K  factor  reported  is  the  arithmetic  mean  K  of  the  ten  observations.  Data  from  many 
similar  calibrations  yield  a  standard  deviation  (s)  of  about  0.03  percent  for  the  NBS 
calibration  procedure.  The  precision  index  (sk)  for  the  mean  value,  is  then 


SK 


0.03% 

y/l6 


0.01% 


(IV-4) 


where  Nj  =  the  number  of  observations  in  the  determination  of  K.  Ni  usually  is  1 0 ;  the 
degrees  of  freedom  is  Ni  - 1  or  usually  9.  Of  course,  this  is  the  precision  index  at  just  one 
pulse  frequency.  The  precision  indices  s]^  for  M  frequencies  must  be  pooled  to  produce 
the  precision  index  (snbs)  for  the  calibration  process: 


sNBS 


M 

2  (N.  -  1) 


(IV-5) 


M 

with  degrees  of  freedom  dfNBS  =  2  (Ni  -  1).  If  the  number  of  tests  at  each  frequency  is 
10,  then  these  calculations  reduce  to  1 


and 


(IV-6) 


dfNBS  =  Mn-1)  =  9M 


(IV-7) 
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Bias  limits  in  the  NBS  dynamic  weight  calibrator  have  been  established  by  repeated 
comparison  calibrations  of  reference  turbine  meters  on  both  volumetric  (stand  pipe) 
calibrators  and  gravimetric  (weigh)  calibrators.  These  comparison  calibrations  were 
performed  at  several  different  locations  and  yielded  a  bias  limit  of  ±0.1  percent.  This 
then  is  the  bias  limit  (b^  b  s  )  reported  by  the  NBS  for  turbine  meter  calibration. 

Uncertainty  in  NBS  turbine  meter  calibrations,  is  then 

U  =  ±(bNBS  +  t95sNBS)  (IV-8) 

If,  for  example,  the  number  of  frequency  settings  is  equal  to  ten,  the  degrees  of  freedom 
are 

dfNBS  -  9  x  10  =  90 

Since  the  degree  of  freedom  is  greater  than  thirty, 

tg5  =  2.00 

and 

U  =  ±(0.1  +  2.00x0.01)  =  0.12% 

4.2. 1.1. 2  Uncertainty  in  the  Working  Standard 

The  working  standard  volumetric  calibrator  generally  consists  of  a  standpipe 
arrangement  with  liquid  level  sensors.  These  mark  the  top  and  bottom  of  a  constant 
volume  interval  (Fig.  IV-4).  The  interlab 
standard  flowmeter  is  connected  in 
series  with  the  calibrator. 

To  calibrate,  liquid  is  forced  out  of 
or  into  the  calibrator  at  a  constant  flow 
rate.  The  number  of  pulses  generated  by 
the  flowmeter  are  counted  while  the 
liquid  between  sensors  A  and  B  is  being 
displaced.  The  volume  (Vi)  between  A 
and  B  is  then  the  quotient  of  the 
number  of  pulses  counted  (Q)  divided 
by  the  turbine  meter  K  factor  (Knbs) 
determined  at  NBS: 

C.  pulses 

V.  =  - - - - - - - - - -  =  gallons  (IV-9) 

1  Knbs  pulses/gallon  v  ’ 

Repeating  the  calibration  process  N  times  improves  the  estimate  of  the  volume,  and  the 
average  of  the  N  calibrations  is 
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Fig.  IV-4  Volumetric  Calibrator 
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The  precision  index  estimate  for  this  determination  of  volume  is  the  precision  index  for 
the  N  determinations  divided  by  the  square  root  of  N. 


Sy  = 


s  V 


Vn 


(IV-11) 


This  is  called  the  standard  error  of  the  mean  for  the  N  determinations.  The  associated 
degrees  of  freedom  is  N  - 1 .  Please  note  in  this  situation,  the  precision  index  of  an 
average  value  (V)  is  of  interest  rather  than  the  precision  index  of  the  individual 
determinations  (Vi).  The  estimating  formula  is  corrected  to  provide  that  estimate  by 
dividing  by  the  square  root  of  N,  the  number  of  determinations. 


The  bias  limit  (by )  for  this  process  is  the  root-sum-square  of  the  bias  limit  reported 
by  the  NBS  (b^ gs )  and  the  best  estimate  of  any  additional  bias  contributed  by  the 
calibration  process. 


Another  way  to  evaluate  the  precision  error  of  the  calibrator  is  to  determine  the 
standpipe  volume  by  some  other  means  and  then  compare  K  factors  determined  by  the 
calibrator  with  those  produced  by  the  NBS  calibrator.  The  standpipe  volume  between  A 
and  B  may  be  determined  by  physical  measurement  of  the  standpipe  dimensions  or  by 
measuring  the  volume  of  liquid  between  A  and  B  with  fixed  volume  standards,  e.g.,  5-, 
10-,  50-,  100-gal  containers.  Then  calibrations  of  the  interlab  standard  turbine  meter  can 
be  performed  with  the  calibrator  by  forcing  liquid  into  or  out  of  the  standpipe  through 
the  turbine  meter  at  a  constant  flow  rate.  The  total  number  of  pulses  generated  while 
flowing  the  volume  of  liquid  between  A  and  B  divided  by  the  measured  volume  yields 
the  meter  K  factor: 


K  = 


total  pulses  pulses 

total  gallons  gallon 


(IV-12) 


By  repeating  this  procedure  several  times  and  calculating  a  mean  calibration  factor 
(K)  for  a  constant  flow  rate  as  the  average  of  the  observed  K  factors, 


K  = 


N 

N 


(IV-13) 


where  N  =  the  number  of  observations  used  to  determine  K 

Kj  =  K  calculated  from  the  i  th  observation 


and  the  precision  index  of  K  is  estimated  from  the  variation  of  Ki  about  K;  it  is  the 
precision  index  for  K  divided  by  the  square  root  of  the  number  of  observations  (N): . 


s  /s(  k.-k) 

SK  <4/  i=l  1 
‘K  ~  “  1  N  (N— 1) 


(IV-14) 
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The  degrees  of  freedom  associated  with  sf  is  N  - 1 . 

If  an  average  K  factor  (K)  is  determined  at  several  different  flow  rates  over  the 
range  of  the  meter  and  corresponding  precision  index,  Sk,  is  calculated  at  each  flow 
rate;  then  pooling  the  precision  indices  provides  an  estimate  of  overall  calibrator  precision 
index: 


s 


ws 


N 


M  „ 

S(N.  -  l)sv 
i=l  J  Ki 


M 

2  (N.-  1) 
J=1  J 


(IV-15) 


The  degrees  of  freedom  associated  with  the  pooled  precision  index  (the  measurement 
instrument  calibration  process)  are  the  sum  of  the  degrees  of  freedom  for  each  flow  rate: 

M 

df  -  2  (N.  -  1)  (IV-16) 

WS  j=l  J 

where  M  =  the  number  of  pulse  frequencies  for  which  a  K  is  determined  and  Nj  =  the 
number  of  observations  made  at  each  frequency  setting.  The  bias  in  this  process  can  be 
estimated  as  follows: 

1.  Calculate  an  average  calibration  factor  K  from  Kj  values  calculated  from 
the  NBS  calibration  data 

2.  Calculate  an  average  calibration  factor  K  from  all  of  the  K’s  Calculated 
from  volumetric  calibrator  data 

3.  Make  the  correction  K  -  K 

4.  Estimates  of  the  limits  of  unknown  bias  (bj )  for  the  process  should  be 
based  on  data  from  interlaboratory  or  interfacility  comparisons  and 
engineering  judgment.  Then 

*>ws  =  i/ow2 3 4  +  (bj)2  (IV-17) 

Finally,  perform  the  calibration  of  the  measurement  turbine  meter  against  the  volumetric 
calibrator  in  essentially  the  same  manner  that  the  interlab  standard  turbine  meter  was 
calibrated.  The  precision  index  (sj)  for  this  calibration  is  calculated  using  Eqs.  (IV-15) 
and  (IV-16).  The  bias  limit  (b)  for  the  measurement  meter  calibration  process  is  simply 
the  best  estimate  based  on  interlab  or  interfacility  comparison  history  and  engineering 
experience. 

The  precision  index  for  the  calibration  hierarchy  is 

2s;2  (IV-18) 
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or 


df,  = 


or 


Bias  limits  for  the  hierarchy  are 


or 


±a/sNBS2  + 

2  2 

S  V  +  sj 

,  /  2 
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ws 
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Bl  =  vVbs2  +  bws2  +  V 

Uncertainty  in  the  calibration  hierarchy  is  calculated  by 

U1  =  ±(B1+  t95si) 


(IV-19) 

(IV-20) 

(IV-21) 

(IV-22) 

(IV-23) 

(IV-24) 

(IV-25) 

(IV-26) 


tgs  is  evaluated  at  dfi  degrees  of  freedom. 

4.2.1. 2  Gravimetric  Calibrations 

The  gravimetric  flow  calibration  system  has  a  calibration 
hierarchy  (Fig.  IV-5)  similar  to  that  for  volumetric 
calibrations.  The  only  difference  is  that  the  working  standard 
is  a  dynamic  weigh  calibrator  rather  than  a  volumetric 
calibrator. 


Fig,  IV-5  Turbine  Meter  Gravimetric 
Calibration  Hierarchy 
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Elemental  errors  in  the  gravimetric  calibration  hierarchy  are  evaluated  in  exactly  the 
same  way  as  those  for  the  volumetric  hierarchy  except  for  the  working  standard. 


Turbine  meter  gravimetric  calibrations  are  accomplished  by  flowing  a  weighed 
quantity  of  liquid  through  the  meter.  Liquid  temperature  and  pressure  are  measured  to 
determine  liquid  density  for  conversion  of  the  weighed  quantity  to  gallons.  The  K  factor 
is  calculated  by  dividing  the  total  number  of  pulses  recorded  by  the  weighed  quantity  in 
pounds  and  multiplying  by  the  density  in  pounds  per  gallon: 


total  pulses  pounds  pulses 
total  pounds  gallon  gallon 

Figure  IV-6  illustrates  the  basic  idea  of  gravimetric  calibration. 


(IV-27) 
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Fig.  IV-6  Gravimetric  Calibrator 


By  flowing  liquid  at  a  constant  flow  rate  through  the  turbine  meter  and  into  the 
weigh  tank  until  the  weight  of  the  liquid  exactly  balances  the  standard  weights,  the 
weighed  quantity  (W)  is  established  in  pounds.  With  the  total  number  of  pulses  generated 
(C)  and  liquid  density  (p)  in  pounds  per  gallon,  Kj  is  calculated  as  follows: 


pulses 

gallon 


(IV-28) 


If  Nj  observations  of  Ki  are  made  at  one  flow  rate,  average  (K)  and  precision  index  (skj) 
can  be  calculated: 

N. 

2  K  .  (IV-29) 

rr  i=l  1 


*K. 

J 


N. 

1  _  2 
2  (K.-  K) 
i=l  1 

N.(N.  -  1) 


(IV-30) 
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Then  if  K  is  established  for  M  different  flow  rates,  the  precision  index  for  the  calibration 
process  is  the  pooled  precision  index  (Sws)  of  the  skj  indices: 


S  =  + 

ws  ~ 


2  (N.-  I)sj7  ‘ 
i=i  1  Kj 


M 

X  (N  .  -  1) 
j=l  1 


Degrees  of  freedom  (dfws)  for  this  process  are  calculated  by 


M 

dfws  =  .SCNj  -  1) 


(IV-31) 


(IV-32) 


Bias  in  this  calibration  process  is  estimated  by  the  method  described  in  Section  4. 2. 1.1. 2. 


Calibration  hierarchy  precision  index  (Si),  degrees  of  freedom  (dfi),  bias  (Bi),  and 
uncertainty  (Ui)  are  calculated  by  Eqs.  (IV-18)  through  (IV-26). 


Fig.  IV-7  Turbine  Meter 

Comparison  Cali¬ 
bration  Hierarchy 


4.2.1. 3  Calibration  by  Comparison 

The  third  method  of  calibration  is  comparison  of  the 
measurement  meter  with  a  working  standard  turbine 
meter.  This  method  substitutes  a  turbine  meter  for  the 
volumetric  or  gravimetric  working  standards  in  the 
calibration  hierarchy  (Fig.  IV-7). 

The  comparison  method  has  not  been  widely 
accepted.  However,  it  does  have  considerable  merit 
especially  in  hydrocarbon  fuel  applications.  The  NBS  has 
recognized  the  use  of  turbine  meters  as  transfer  standards 
because  they  are  very  repeatable.  The  NBS  has,  in  fact, 
used  turbine  meters  as  transfer  standards  in  evaluating  bias 
in  the  NBS  dynamic  weigh  calibrator. 


The  precision  index  and  bias  limit  estimates  for  the  interlab  standard  are  made  in 
the  same  way  as  for  the  volumetric  calibration  system.  The  working  standard  turbine 
meter  is  calibrated  against  the  interlab  standard  turbine  meter  by  installing  the  two 
meters  in  series  in  a  flow  system.  Figure  IV-8  illustrates  a  typical  setup  for  comparing 
turbine  meter  with  turbine  meter. 


A  B 


Fig.  IV-8  Comparative 
Calibration 
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By  considering,  for  example,  meter  A  to  be  an  interlab  standard  and  meter  B  to  be 
a  working  standard,  a  calibration  can  be  performed  as  follows: 

1.  Adjust  the  flow  rate  by  observing  the  frequency  of  meter  A.  From  the 
NBS  calibration  curve,  determine  the  interlab  standard  K  factor  for  the 
particular  frequency. 

2.  With  the  flow  rate  adjusted  and  constant,  allow  the  ratio  counter  to  count 
the  total  number  of  pulses  generated  by  meter  A  over  some  predetermined 
time  period.  The  counter  will  simultaneously  count  the  total  number  of 
pulses  generated  by  meter  B  over  the  same  time  period.  The  counter  will 
then  display  digitally  the  ratio  (R): 

total  pulses  —  A 

total  pulses  —  B  (IV-33) 


"  ~R  (IV-34) 


(IV-35) 


R 

then 

KB 

and 


Thus,  calculate  Kj  for  each  frequency  setting  fA .  If  Ni  observations  are  made  at  each 
frequency  setting,  an  average  calibration  factor  (K)  can  be  calculated  for  meter  B  at  fs 
by 


K  = 


Ni 

N. 

j 


(IV-36) 


The  precision  index  for  this  average  calibration  factor  is  the  precision  index  of  the 
calibration  values  divided  by  the  square  root  of  the  number  of  observations  (Nj): 


SK. 

i 


VNj 


=  ±‘ 


X  (KB  -  K) 

i=l  i 
N.(N.~  1) 


(IV-37) 


If  a  K  is  determined  at  M  different  frequencies  over  the  range  of  the  meter,  the  precision 
index  (sws)  for  the  calibration  process  is  the  pooled  value  for  all  frequencies: 


S  ws 


s  if .  2 

X  (N.  -  1) 


(IV-38) 
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The  degrees  of  freedom  (dfws)  for  the  calibration  process  are 

M 

dfws  =  S(Nrl)  (IV-39) 

Bias  limits  (bws)  for  the  process  are  again  based  on  interlab  and  interfacility  comparison 
history  and  engineering  judgment. 

Precision  index  (Si),  degrees  of  freedom  (dfi),  bias  limits  (Bi),  and  uncertainty 
(Ui)  for  the  calibration  hierarchy  are  calculated  using  Eqs.  (IV-18)  through  (IV-26). 

Some  important  considerations  which  have  not  been  mentioned  heretofore  are: 

1.  At  each  level  in  the  calibration  hierarchy,  the  flowmeter  being  calibrated 
should  be  accompanied  by  the  plumbing  upstream  and  downstream  of  the 
meter  in  its  use  condition.  Tests  have  shown  that  inadequate  control  of 
the  velocity  profile  is  perhaps  the  strongest  argument  against  the  use  of 
reference  turbine  meters  as  standards  (see  page  184  of  “Turbine 
Flowmeter  Performance  Model,”  (AD825354)  prepared  by  Greyrad 
Corporation). 

2.  If  at  all  possible,  turbine  meters  should  be  calibrated  with  the  use  liquid  at 
run  conditions  of  temperature  and  pressure. 

These  considerations  will  minimize  the  errors! 

4.2.2  Data  Acquisition  Errors 

The  effect  of  data  acquisition  errors  is  determined  by  applying  a  known  frequency 
(X)  to  the  data  acquisition  equipment  (Fig.  IV-9). 


Frequency  Digits  Pulses 


Fig.  IV-9  Data  Acquisition  System  Calibration 
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In  the  case  of  digital  counters,  the  total  number  of  input  pulses  is  counted  over 
some  preset  period  of  time  and  the  digital  indication  is  recorded.  Then  the  recorded  value 
can  be  compared  with  the  input.  If  M  recordings  on  N  channels  are  made,  then  the 
average  (Xj )  for  one  channel  is 


X.  =  S—  (IV-40) 

J  i=l  M 

where  Xj  =  the  recorded  value  for  the  ith  recording.  The  grand  average  (X)  for  all 
channels  is 


X 


N 


& 

N 


The  precision  index  (sx)  for  digital  counter  channels  is 


(IV-41) 


(IV-42) 


The  degrees  of  freedom  (dfj)  are  the  number  of  recordings  minus  one,  i.e.,  N-l. 

Bias  limits  for  the  data  acquisition  process  are  left  to  the  judgment  of  the  most 
knowledgeable  data  recording  engineers.  Errors  incurred  by  frequency-to-analog  and 
analog-to-digital  conversions  are  evaluated  by  comparing  known  input  frequencies  (f)  with 
recorded  frequencies.  The  known  frequency  (f)  is  applied  to  N  channels,  and  M  multiple 
scan  recordings  are  made.  A  multiple  scan  average  (fy)  is  calculated  for  each  channel  for 
each  recording.  The  average  (fj )  for  each  recording  on  the  jth  channel  is 


f.  = 


M 

2  fJ{ 

i=i 


ij 


J  M 


The  grand  average  (f)  for  all  channels  is 


N 

STi 

7  =  i=1 


N 


The  precision  index  (sf)  is  then 


s7  =  ±')j- 


N  _  _  2 

X  ( f.  -  f) 

i=l 


] 


N  -  1 


(IV43) 


(IV-44) 


(IV-45) 
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The  degrees  of  freedom  (dff )  in  this  case  are 

dff=N-l  (IV-46) 

Bias  limits  (bf)  for  frequency-to-analog  and  analog-to-digital  conversion  must  be  estimated 
and  root-sum-squared  with  the  bias  limits  (bfQ)  for  the  input  frequency  (f)  as  determined 
from  the  frequency  standard  calibration  hierarchy,  i.e., 

W  -  ±Af2  +  bf02 


4.2.2. 1  Multiple  Instruments 

Because  of  the  lack  of  flow  rate  standards,  i.e.,  gallons  per  minute  or  pounds  per 
second  standards,  multiple  instrumentation  for  flow  measurement  is  highly  recommended. 
Correct  application  of  multiple  measurement  statistics  will  never  yield  an  estimate  of 
precision  error  larger  than  that  obtained  with  single  measurements.  The  typical  multiple 
instrumentation  situation  provides  a  reduction  in  precision  error.  The  measurement 
provided  by  the  average  of  several  instruments  is  more  precise  than  any  individual 
instrument  of  that  set.  The  reduction  of  precision  error  is  indicated  by  the  precision 
index  (savg)  of  several  instruments: 


S.  J 
in  d 


(IV47) 


where  sin<j  =  the  precision  index  of  the  individual  instrument  and  K  is  the  number  of 
instruments.  The  formula  for  calculating  savg  is  as  follows  when  the  simple  average  of 
multiple  instruments  is  used: 


s 


avg 


If  individual  instruments  are  weighted  when  combined,  the  formula  for  savg  is  more 
complex. 


Analysis  of  flowmeter-to-flowmeter  multiple  measurements  yields 


1.  Pooled  within-run  precision  index  (Swr)  and 

2.  Pooled  run-to-run  precision  index  (Srr). 

Appendix  C  gives  derivations  and  formulation  for  calculating  the  above  precision  indices. 


Further  analysis  of  multiple  measurement  data  will  provide  an  estimate  of  flowmeter 
calibration-to-calibration  precision  error  (Scc)  which  includes 


1.  Flowmeter  nonrepeatability  during  calibration, 

2.  Installation  effects  between  calibration  facility  and  engine  test  stand,  and 
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3.  Calibration  facility  nonrepeatability,  which  includes  temperature  and 
pressure  errors  in  defining  density  during  calibration. 

Derivations  and  formulation  for  evaluating  Scc  are  also  in  Appendix  C. 

4.2.3  Data  Reduction  Errors 


Data  reduction  errors  are  those  errors  incurred  in  reducing  measured  units  to  units 
of  flow  and  fall  into  the  following  three  categories: 

1.  Density  determination  errors, 

2.  Precision  errors  resulting  from  test  dynamics,  and 

3.  Computer  resolution  errors. 

4.2.3. 1  Density  Determination  Errors 

Errors  in  density  determination  are  a  result  of  errors  in  the  measurement  of  fuel 
temperatures  and  pressures.  At  this  point,  these  errors  may  be  called  Sde  for  the  precision 
index  and  bde  for  the  bias  limits. 


The  effect  of  fuel  pressure  precision  errors  on  fuel  density  is  calculated  from 


S  -  +  1  dP  c 
d*l  -  5PSP 

where  Sp  =  Pressure  measurement  precision  index 

— 7=-  =  Factor  to  account  for  K  multiple  pressure  measurements 

VK 

dp 

- =  The  partial  derivative  of  the  fuel  density  versus  pressure 

^  relationship 


(IV-48) 


The  degrees  of  freedom  associated  with  Sde  are  the  same  as  that  for  the  pressure 
measurement : 


df .  =  dfn 

de.  p 


(IV-49) 


The  effect  of  fuel  pressure  measurement  bias  on  fuel  density  is 

B^  ■  %  bp 


(IV-50) 


The  effect  of  fuel  temperature  precision  error  on  fuel  density  (Sde2)  is  calculated  as 
follows : 
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where 


+J_  &. 

~y/ldT 


sT 


(IV-51) 


1 

VK 


factor  to  account  for  K  multiple  temperature  measurements 


bp_ 

9T 


the  partial  derivative  of  the  fuel  density  versus  temperature 
relationship. 


The  degrees  of  freedom  associated  with  Sde2  are  the  same  as  the  degrees  of  freedom 
for  the  temperature  measurement  precision  index,  i.e., 

dfde2  =  dfT  (IV-52) 

The  effect  of  fuel  temperature  bias  on  fuel  density  (Bde2)  is  calculated  from 


.  #bt 

dT  T 


(IV-53) 


4.2.3. 2  Computer  Resolution 


Computer  resolution  is  the  source  of  a  small  elemental  error.  Even  the  small 
computers  used  in  experimental  test  applications  have  six  digit  resolution  (most  have 
eight  or  more).  The  resultant  full-scale  error  would  be  plus  or  minus  one  in  106.  Even 
though  this  error  is  probably  negligible,  some  consideration  should  be  given  to  it. 


Two  types  of  measurement  resolution  systems  are  in  use,  truncating  systems  and 
rounding  systems.  Consideration  will  be  given  the  elemental  bias  and  precision  errors 
inherent  in  each  of  these. 


In  multiplying  or  dividing  with  six  or  eight  digit  numbers,  the  results  may  have  more 
digits  than  the  system  resolution.  The  truncating  system  will  eliminate  digits  on  the  right 
until  the  maximum  allowable  are  left.  This  results  in  a  bias  of  1/2  digit  and  a  uniform 
distribution  of  precision  errors  over  the  interval  ±1/2  digit.  The  elemental  precision  index 
for  this  type  of  distribution  is  derived  from  the  precision  index  of  a  uniform  distribution 
(Appendix  A): 


s 


V 


(lower  limit  -  upper  limit) ^ 
12 


(IV-54) 


The  elemental  precision  error  will  be  ±3/10  of  a  digit. 


The  rounding  system  will  also  reduce  the  number  of  digits  to  the  resolution  of  the 
computer.  In  doing  this  it  will  increase  the  first  digit  on  the  right  by  one  approximately 
half  of  the  time.  The  decision  to  increase  the  digit  is  based  on  the  size  of  the  last  digit 
eliminated  (and  others  if  necessary). 


72 


A  E  D  C-T  R-73-5 


The  bias  error  of  1/2  digit  experienced  with  the  truncating  system  is  eliminated.  The 
precision  error,  however,  is  not  eliminated.  It  remains  the  same,  ±3/10  of  a  digit.  For  a 
six-digit  computer,  the  precision  error  is 

SCR  =  ±3/10  x  10'6 


The  conclusion  is  that  the  rounding  system  is  superior  to  the  truncating  system,  and 
if  a  choice  exists,  the  rounding  system  should  be  used. 

4.3  FUEL  FLOW  MEASUREMENT  ERRORS 


Fuel  flow  measurement  errors  when  flowmeter  calibrations  are  performed  off  site 
and  multiple  measurements  are  made,  are  then 


si2  +  sx2 


+  Swr2  +  Srr2  +  +  sde2 


where  S  =  precision  index  for  the  fuel  flow  measurement  and  =  the  factor  to  account 


(IV-55) 


for  K  multiple  instruments  which  are  averaged  to  provide  the  measurement. 

/  c  2  _  2  c  2  c  2  c  2  2\ 

1  5 1  +  SY  +  S  +  o  +  o  +  s  ,  1 

\  1  A  wr  rr  cc  de  / 

di  =  - 


s.4  s-j4  s  4  s  4 

—  +  +  ——  +  , 
df.  dfc  df  df  df 

1  A  wr 


(IV-56) 


df 


d  e 


where  df  =  degrees  of  freedom  associated  with  the  precision  index  (S).  The  bias  limit 
usually  is  not  reduced  when  multiple  instruments  are  used  because  they  usually  have 
equal  biases.  Bias  errors  would  be  reduced  by  averaging  if  the  meters  were  calibrated 
independently  at  different  facilities.  The  bias  limit  would  be 

B  =  ±  V  B,2  +  bj2  +  bde2  (IV-57) 

where  B  =  the  bias  limits  for  the  measurement  process.  In  Eqs.  (IV-55)  through  (IV-57) 
if  a  frequency-to-digital  conversion  process  was  employed  rather  than  counters,  sx,  bx, 
and  dfx  may  be  replaced  with  Sf,  bf,  and  dff.  The  uncertainty  would  be 

U  =  ±(B  +  t95S)  (IV-58) 


4.4  END-TO-END  CALIBRATION 

The  best  method  for  determining  the  errors  incurred  in  the  flow  measurement 
process  would  be  to  flow  a  weighed  quantity  or  measured  volume  of  fuel  through  the 
turbine  meters  during  an  engine  run.  That  is,  an  in-place,  end-to-end  calibration  would  be 
performed  during  an  engine  run.  Figure  IV-10  illustrates  a  typical  arrangement  of 
components  for  performing  calibrations  of  this  nature. 
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As  an  example,  suppose  a  measured  quantity  (gravimetrically  or  volumetrically)  of 
fuel  was  flowed  through  two  flowmeters  in  series  to  the  gas  turbine  engine  during  a  run. 
During  the  period  required  to  flow  the  measured  quantity,  record  the  following: 

1 .  Total  pulses  generated  by  each  meter, 

2.  Fuel  temperature  and  pressure  for  density  determination,  and 

3.  The  value  for  the  measured  quantity  in  gallons  or  pounds. 


Frequency 


Flow  Rate 


Flow  Rate 


Fig.  IV-10  End-to-End  Calibration 


From  these  data  a  meter  factor  can  be  calculated. 


total  pulses 
total  gallons 


(IV-59) 


for  each  meter.  Then  if  N  runs  are  made  the  precision  index  for  data  acquisition  and 
reduction  for  each  meter  is 


(IV-60) 
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This  precision  index  will  include  the  effects  of 

1.  Meter  nonlinearity 

2.  Electrical  calibration 

3.  Counter  or  other  frequency-to-digital  conversion 

4.  Digital  recording 

5 .  Density  determination 

6.  Computer  resolution 

7.  Calibration  to  calibration  precision  error 

The  only  precision  errors  not  included  in  s\  are  within-run-precision  error  (Swr)  and  the 
precision  error  (sws)  of  the  working  standard  (calibration  system)  calibration  process. 
Fuel  flow  measurement  precision  index  (S)  is  then 


S  = 

Vk 


+  s. 


+ 


(IV-61) 


1 


where  ^7==  =  the  factor  to  account  for  averaging  K  multiple  instruments.  Derivations  and 

formulation  for  calculating  Swr  are  in  Appendix  C.  The  working  standard  precision  error 
can  be  determined  using  Eq.  (IV-15)  or  (IV-30),  depending  on  the  type  of  working 
standard  used. 


Degrees  of  freedom  for  the  flow  measurement  process  are 


df  = 


/  2  .  q  2  .  2  > 

(Si  wr  w  s  / 

T7  r7  T"7" 

1  wr  ws 

df.  +  df  +  df 


(IV-62) 


1  wr  w  s 

where  df  defines  individual  degrees  of  freedom  associated  with  each  precision  index. 

Bias  limits  (B)  in  the  flow  measurement  made  by  this  method  are  the  bias  in  the 
working  standard  plus  any  additional  bias  based  on  engineering  judgment. 

Uncertainty  in  the  measurement  is  then 


U  =  ±(B+  t95S) 


(IV-63) 


75 


AEDC-TR-73-5 


4.5  SUMMARY 


In  summary,  the  elemental 
errors  to  be  evaluated  are  listed  in 
Table  XIII  when  off-site  calibra¬ 
tions  are  performed.  If  end-to-end 
calibrations  are  performed  while  an 
engine  test  is  in  progress,  the 
agony  of  evaluating  all  of  the 
above  errors  is  eliminated  except 
those  errors  determined  from  mul¬ 
tiple  measurement  statistics  which 
must  be  evaluated  in  either  case. 


Table  XIII  Elemental  Errors 


Source 

Bias 

Limit 

Precision 

Index 

Degrees  of 
Freedom 

Calibration 

Bi 

Si 

dfi 

Data  Acquisition 

bx 

sx>  Swr, 
Srr>  SCc 

dfx>  dfwr, 
dfrr,  dfcc 

Data  Reduction 

bde 

sde 

dfde 
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SECTION  V 

PRESSURE  AND  TEMPERATURE  MEASUREMENTS 


5.1  GENERAL 


Pressure  and  temperature  measurements  are  important  in  the  evaluation  of  gas 
turbine  engine  performance  parameters6 ,  and  this  section  is  devoted  to  the  consideration 
of  errors  in  measurements. 


Strain-gage-type  pressure 
transducers  are  the  most 
common  devices  used  for  the 
measurement  of  pressures  in 
gas  turbine  engine  testing. 
Strain-gage  pressure  trans¬ 
ducers  are  best  described  as 
devices  which  have  strain 
gages  fixed  directly  to  a 
diaphragm  or  other  pressure 
sensitive  surface.  The  meas¬ 
ured  strain  is  calibrated  in 
terms  of  pressure.  Figure  V-l 
is  a  simplified  diagram  illus¬ 
trating  the  circuitry  for  meas- 


Strain  Gages 


Excitation 
Voltage  Source 


Fig.  V-1  Strain-Gage  Pressure  Transducer  Circuitry 

urement  of  pressure  with  a  strain-gage-type  pressure  transducer. 


There  are  two  different  meth¬ 
ods  for  calibrating  pressure  trans¬ 
ducers.  One  method  (Fig.  V-2) 
consists  of  subjecting  the  transducer 
and  a  pressure  standard  to  the  same 
pressure  and  recording  the  outputs. 
Eleven  or  more  pressure  levels  over 
the  range  of  the  transducer  are 
recommended.  One  such  pressure 
standard,  which  has  gained  in  popu¬ 
larity  in  recent  years,  employs  a 
fused  quartz  helical  bourdon  tube  and 
optical  techniques  to  produce  a 
digital  indication  of  the  applied 
pressure. 


Fig.  V-2  Pressure  Transducer  Calibration  with 
Pressure  Standard 


6 For  a  definition  of  terms  used  in  this  Handbook,  see  Glossary  in  Section  IX. 
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Weights 


The  second  method  (Fig.  V-3) 
consists  of  applying  known  pressures 
to  the  transducer  using  an  air  or 
liquid  deadweight  piston  gage. 

Thermocouples  are  the  most 
commonly  used  devices  for  measuring 
gas  turbine  engine  temperatures.  Re¬ 
sistance  thermometers  are  also  used  in 
gas  turbine  testing.  Figure  V-4  illus¬ 
trates  typical  hook-ups  for  tempera¬ 
ture  measurement  using  resistance 
thermometers  and  thermocouples. 


Fig.  V-3  Deadweight  Piston  Gage  There  are  two  methods  of  cali¬ 

brating  thermocouples  and  resistance 
thermometers:  (1)  by  comparison  with  fixed  temperature  points  and  interpolated  points 
as  defined  by  the  International  Practical  Temperature  Scale  of  1968,  and  (2)  by 
comparison  with  platinum-rhodium  thermocouples  or  resistance  thermometers  used  as 
standards. 


Measuring 

Junction 


Metal 


A 


U — L. Metal  B 


Reference 

Junctions 


Copper 

Wire 


Voltage 

Measuring 

Instrument 


a.  Resistance  Thermometer  b  Thermocouple  System 

Three-Wire  System 

Fig.  V-4  Temperature  Measurement 

Multiple  concurrent  measurements  of  pressure  or  temperature  parameters  along  the 
gas  path  of  a  gas  turbine  engine  are  rarely  achieved  because  of  profile  effects.  Multiple 
concurrent  measurements  of  pressure  or  temperature  parameters  in  a  turbine  engine  fuel 
supply  system  or  airflow  measuring  system,  however,  are  easily  accomplished  and  should 
be  practiced  whenever  accuracy  requirements  dictate. 
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As  an  example,  multiple 
measurement  of  fuel  tempera¬ 
ture  is  accomplished  by  the 
installation  of  transducers  in 
adjacent  probe  bosses  in  a  man¬ 
ner  which  will  allow  the  two 
transducers  to  see  the  same 
temperature.  Figure  V-5  illus¬ 
trates  an  accepted  method  of  probe  boss  arrangement. 


a.  Front  View 

Fig.  V-5 


b.  Side  View 
Probe  Boss  Arrangement 


When  the  average  pressure  at  a  given  turbine  engine  station  is  required,  several 
individual  pressure  measurements,  each  at  a  unique  geometric  location,  are  generally 
made.  If  the  individual  pressure  measurements  are  independent,  then  the  precision  index 
of  the  average  pressure  is 


S 


A 


(V-l) 


where  Sp  is  the  probe  precision  index,  N  is  the  number  of  independent  pressure 
measurements,  and  Sj  is  the  transducer  precision  index. 


5.2  PRESSURE  MEASUREMENT  ERROR  SOURCES 
5.2.1  Calibration  Hierarchy  Errors 

Figure  V-6  illustrates  a  typical  pressure  calibration 
hierarchy. 

In  the  typical  hierarchy,  deadweight  piston  gages  are 
used  as  standards  at  the  upper  three  levels.  Calibration  of 
deadweight  piston  gages  is  accomplished  by  comparisons 
with  other  deadweight  piston  gages.  Figure  V-7  illustrates 
the  setup  for  this  method  of  calibration. 

Weights  are  applied  to  the  weight  table  of  tester 
number  one  until  the  weights  on  tester  number  two  are 


Fig.  V-6  Pressure  Trans¬ 
ducer  Calibra¬ 
tion  Hierarchy 


Fig.  V-7  Deadweight 
Piston  Gage 
Calibration 
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exactly  balanced.  Knowledge  of  the  effective  area  of  the  piston  in  tester  number  one  and 
the  total  mass  of  the  applied  weights,  weight  table,  and  piston  for  each  tester  will  allow 
calculation  of  the  effective  area  of  the  piston  in  tester  number  two  by  the  relationship 


then, 


(V-2) 


A 


2 


A1M2 

Mi 


(V-3) 


where  Ai 


the  effective  area  of  the  piston  in  tester  number  one  in  square 
inches 


A2 


the  effective  area  of  the  piston  in  tester  number  two  in  square 
inches 


Mi  =  the  total  mass  of  applied  weights,  weight  table,  and  piston  for 
tester  number  one  in  pounds 

M2  =  the  total  mass  of  applied  weights,  weight  table,  and  piston  for 
tester  number  two  in  pounds 


Determination  of  the  piston  area  at  several  pressures  over  the  range  of  the  gage  and 
repeatedly  at  each  pressure  point  will  yield  a  distribution  of  data.  The  precision  index 
(Sa)  is  the  standard  error  of  the  mean  for  the  calibration  process  and  is  estimated  from 
the  variation  of  the  individual  area  determinations  about  the  average  (A).  When 


Xs  = 


£.A« 


and 


A 


K 

&A* 

K 


(V-4) 


(V-5) 


thus, 


sj  .4 


N  _  2 
2  (A.  —  A.) 
j=l  ] 

K  (N  -  1) 


(V-6) 
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where  N  =  the  total  number  of  observations  made  at  each  pressure  set  point 
during  the  calibration 

Aj  =  the  average  piston  area  at  each  pressure  set  point 
A  =  the  average  effective  piston  area 
K  =  the  number  of  pressure  set  points 

Aj  =  the  area  determination  at  each  individual  observation  at  each  set 
point 

Degrees  of  freedom  (dfx )  associated  with  the  precision  index  (Sa  )  are 

dfx  =  K(N-l)  (V-7) 


Pressure  measurements  can  be  made  with  deadweight  piston  gages  with  uncertainties 
of  ±0.01  percent.  To  do  so,  a  number  of  parameters  of  the  instrument  and  its 
environment  must  be  considered.  Consideration  of  these  parameters  is  primarily  for  the 
purpose  of  minimizing  the  bias  errors  incurred  by  variations  in  the  parameters.  Principal 
instrument  parameters  are  evaluated  during  calibration,  but  the  user  must  evaluate  those 
of  the  environment.  For  example,  the  pressure  developed  by  a  deadweight  piston  gage  is 
given  by  the  formula 


V(?fa“Pa> 

kgT  +  - 7 -  kf 


P  [1  +  a(t-  t  )][1  +  bp  ][1  +  d(p  |SP  -p.)] 

S  p  z  o  zpj 


(V-8) 


where  pp  =  pressure  at  the  reference  level,  psi 

Mm  =  mass  of  the  weights,  including  the  piston  assembly,  lb 

A0  =  effective  area  (mean  area  of  the  piston  and  cylinder)  in 
in.2 ,  at  atmospheric  pressure,  temperature  ts,  and 
jacket  pressure  pzo 

pa  =  mean  density  of  the  air  displaced  by  the  load,  lb/in.3 
pm  =  density  of  the  weights,  lb/in.3 
k  =  1/980.665 

gL  =  local  acceleration  due  to  gravity,  cm/sec2 

V  =  volume  of  oil  in  in.3  contributing  to  the  load  on  the  piston 

pfa  =  density  of  the  pressure  fluid  at  atmospheric  pressure,  lb/in.3 

7  =  surface  tension  of  the  pressure  fluid,  lbf/in. 

C  =  circumference  of  the  piston  assembly  in  inches  at  the  surface 
of  the  pressure  fluid 
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a  =  fractional  change  in  area  per  °C,  and  taken  as  equal  to  the  sum 
of  the  thermal  coefficients  of  linear  expansion  of  the  piston 
and  cylinder 

t  =  temperature  of  the  piston  gage,  °C 

ts  =  reference  temperature  at  which  the  value  for  A0  is  known 

b  =  fractional  change  in  effective  area  for  1-psi  change  in  pressure 

d  =  fractional  change  in  effective  area  for  1-psi  change  in 
jacket  pressure 

pzo  =  jacket  pressure  in  psi  required  to  reduce  the  piston-cylinder 
clearance  to  zero  when  pp  =  0 

Sz  =  rate  of  change  of  zero  clearance  jacket  pressure  (pzo )  with 
measured  pressure  (pp ),  psi 

pj  =  jacket  pressure,  psi 


Obviously,  treatment  of  each  of  these  variables  is  beyond  the  scope  of  this  work.  They  are 
presented  so  that  the  reader  will  be  aware  of  the  considerations  that  must  be  made  if  bias  is 
to  be  held  to  a  minimum.  The  NBS  will  report  bias  limits  for  any  calibration  performed  at 
the  Bureau.  Bias  limits  at  the  lower  levels  are  dependent  on  the  amount  of  calibration  data 
available  and  the  judgment  of  the  one  responsible  for  calibration  data  analysis.  The  bias  (bi) 
at  each  level  in  tne  hierarchy  is  at  least  as  large  as  the  bias  estimated  for  the  previous  level; 
therefore  a  conservative  estimate  is 


Bi  = 


(V-9) 


Upon  completion  of  a  strain-gage  pressure  transducer  calibration,  a  least-squares 
polynomial  curve  may  be  fitted  through  the  data  such  that 


where 


X 

P 

A0,  Ai,  A2,  and  AM 
X 
K 

M 


-  A0  +  A1P  +  A2p2  +  •"  +  AMpK 

=  pressure  in  psia,  psid,  or  psig 
=  curve  coefficients 
=  transducer  output  voltage 

=  degree  of  the  curve  fit,  i.e.,  the 
largest  exponent  of  P 

=  the  number  of  curve  coefficients 


(V-10) 


The  errors  attributed  to  the  calibration  process  are  then  the  same  as  those  discussed  in 
Section  III  for  laboratory-calibrated  force  transducers.  The  precision  index  (s*)  at  any 
pressure  pi  is  calculated  (Fig.  V-8)  as 


(V-ll) 
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where  Xi  =  measured  output  voltage  corresponding  to 

the  applied  pressure  (P) 

X  =  output  voltage  from  the  curve  at  pressure  (P) 
N  =  number  of  calibration  points  at  pressure  (P) 


The  best  procedure  is  to  calculate  a 
precision  index  for  each  pressure  set  point 
and  report  the  largest  as  the  precision  index 
for  the  calibration  process. 

The  degrees  of  freedom  (dfi)  associ¬ 
ated  with  this  precision  index  are 

dfj  =  N  -  1  (V-12) 

Bias  limits  for  this  calibration  process 
are  left  to  the  judgment  of  the  instrumenta¬ 
tion  engineer. 


Fig.  V-8  Precision  Index  at  Any  Applied 
Pressure  (P) 


The  precision  index  for  the  complete  hierarchy  is  calculated  by  root-sum- squaring  the 
si  for  each  level : 


si  =  y  2  si2  (V-13) 

The  degrees  of  freedom  for  the  complete  hierarchy  are  estimated  using  the 
Welch-Satterth waite  technique: 

dfi  =  [s  si2]2/[X(si4/dfi)]  (V-14) 

The  bias  limit  for  the  hierarchy  would  be  the  root-sum-square  of  the  bias  limits  for 
each  level : 


Bj  =  yibT  (V-15) 

5.2.2  Data  Acquisition  and  Reduction  Errors 

One  method  of  determining  the  overall  effect  of  the  data  acquisition  and  reduction 
processes  is  by  the  periodic  performance  of  special  tests.  First,  select  several  (four  to  ten) 
pressure  transducers  at  random  from  the  pool  of  calibrated  pressure  transducers.  Connect 
the  transducers  to  a  common  manifold  (Fig.  V-9).  Follow  the  customary  recording  system 
pre-run  setup  procedures.  Apply  nominal  pressure  to  the  manifold,  and  make  a  multiple 
scan  (ten  or  more)  recording  of  transducer  outputs.  Also,  record  the  level  of  the  applied 
pressure  as  defined  by  a  pressure  standard  (deadweight  piston  gage  or  equivalent).  Return 
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the  manifold  pressure  to  atmospheric,  and  then  again  apply  the  nominal  pressure  and  record 
as  before.  Repeat  this  procedure  at  least  four  times,  i.e.,  make  at  least  four  multiple  scan 
recordings  of  transducer  outputs  with  nominal  pressure  applied.  Reduce  the  data  by  means 
of  the  normally  used  gas  turbine  engine  data  reduction  program.  Calculate  a  multiple  scan 
average  (Xjj)  for  each  transducer  at  each  set  point: 

N 

Y  &***  (V-16) 


where  N  =  number  of  scans  recorded  and  Xijk  =_pressure  indicated  by  the  jth  transducer  on 
the  ith  scan  of  the  kth  recording.  The  average  (Xj)  for  all  set  points  on  the  jth  transducer  is 


M  _ 

2  x.. 

i=i  1J 
M 


(V-17) 


where  M  =  the  number  of  pressure  set  points. 


The  precision  error  for  the  data_acquisition  and  reduction  system  is  estimated  by  the 
variation  of  the  set  point  recordings  (Xjj)  about  the  average  (Xj)  for  each  transducer: 


s . 
] 


(V-18) 


This  estimate  is  pooled  for  L  transducers  to  estimate  the  precision  index  for  the  data 
acquisition  and  reduction  system : 


S* 


L  Mj  _  2 

2  2  (x..-  X.) 


'  j=l  i=l 


ij  J 


L 

2  (M.  -  1) 
j=l  J 


(V-19) 
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The  degrees  of  freedom  (df)  associated  with  the  precision  index  are 

df-  =  2  (M-  -  1)  (V-20) 

x  j=i  J 

Bias  limits  for  these  tests  will  be  based  on  engineering  judgment  supported  by  special  test 
histories. 

These  statistics  include  the  effects  of  the  following: 

1 .  Pressure  standard 

2.  Pressure  transducer 

3.  Excitation 

4.  Electrical  calibration  of  the  recording  system 

5.  Signal  conditioning 

6.  Recording  system 

7.  Data  reduction 

but  do  not  include  the  effects  of 

1.  Probe  or  tap  design  and/or  coupling  configuration 

2.  Environmental  conditions 

3.  Pressure  variations  during  engine  testing 

5.2.3  Probe  Errors 

Treatment  of  errors  from  probe  or  tap  design  is  beyond  the  scope  of  this  Handbook. 
The  reader  is  referred  to  several  excellent  references  which  should  provide  the  background 
required  to  complete  an  error  analysis: 

1.  “Aerodynamic  Measurements,”  Robert  C.  Dean,  Jr.,  MIT  Press,  1953,  Chapters  3 
and  5. 

2.  “Considerations  Entering  into  the  Selection  of  Probes  for  Pressure  Measurements 
in  Jet  Engines,”  Clarence  C.  Gettelman  and  Lloyd  N.  Krause,  ISA  Proceedings, 
Volume  7,  Paper  No.  52-12-1. 

3.  “Effect  of  Interaction  among  Probes,  Supports,  Duct  Walls,  and  Jet  Boundaries 
on  Pressure  Measurements  in  Ducts  and  Jets,”  Clarence  C.  Gettelman  and  Lloyd 
N.  Krause,  ISA  Proceedings,  Volume  7,  Paper  No.  52-12-2. 

4.  “Review  of  the  Pitot  Tube,”  R.  G.  Folsom,  ASME  Transactions,  October  1956. 
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5.  “Characteristics  of  a  Wedge  with  Various  Holder  Configurations  for  Static 
Pressure  Measurements  in  Subsonic  Gas  Streams,”  NACA  RM  E51G09, 
September  1951. 

6.  “An  Investigation  of  the  Influence  of  Orifice  Geometry  on  Static  Pressure 
Measurements,”  R.  E.  Rayle,  Jr.,  MS  Thesis,  MIT,  1949. 

As  an  example  of  the  type  of  error  referred  to  here,  suppose  an  engineer  wants  to  make 
velocity  coefficient  corrections  to  total  pressure  measurements.  Very  likely,  the  correction 
will  be  of  the  form 


where 


Pt  =  actual  total  pressure 
Pxm  =  measured  total  pressure 
(PTm  -  Pt)/q  =  velocity  coefficient 

q  =  velocity  head  =  Vi  pV2 


(V-2 1 ) 


Velocity  coefficients  for  each  probe  may  be  determined  by  calibration.  Calibration 
data  will  yield  the  precision  index  (SpT  )  and  bias  limit  (BpT  ).  Expanding  Eq.  (V-2 1)  in 
the  Taylor’s  series  gives 


Sp 


T 


(V-2  2) 


and 


Bp 


T 


(V-23) 


It  is  to  be  noted  that  the  term  (Pjm  -  Pt  )/q  is  treated  as  a  constant  with  bias  error 
only,  whereas  the  term  q  has  only  precision  error  with  bias  being  negligible. 

Pressure  variations  caused  by  the  engine  or  facility  are  not  errors.  The  reader  is 
cautioned  that  time  variant  data  adds  additional  complexity  to  the  uncertainty  analysis  (see 
Section  8.7). 

The  pooled  within-run  precision  index  (Swr)  and  pooled  run-to-run  precision  index 
(Srr)  may  be  obtained  from  multiple  measurements.  Derivations  and  formulation  for 
calculating  Swr  and  Srr  are  in  Appendix  C. 
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5.2.4  Pressure  Measurement  Error  Summary 


Finally,  if  precautions  are  taken  to  make  environmental  effects  negligible  or  laboratory 
tests  are  performed  similar  to  those  suggested  in  Section  III  for  determining  their  effects, 
the  measurement  precision  index  may  be  calculated  from 


- 


+  v 


+  s* 


+  sv 


(V-24) 


where  S\  =  calibration  hierarchy  precision  index 

Sx  =  data  acquisition  and  reduction  precision  index 

Sw  r  =  within-run  precision  index  (multiple  measurements  only) 

Se  =  precision  error  due  to  environmental  effects 

Sb  =  precision  error  due  to  the  measurement  of  barometric  pressure 
if  transducer  zero  corrections  are  in  the  data  reduction  process 
for  absolute  pressure  measurement  or  if  gage  pressure 
measurements  are  made 

Srr  =  Run-to-run  precision  index  (multiple  measurements  only) 

Sp  T  =  probe  velocity  coefficient  precision  index  (when  applicable) 


The  degrees  of  freedom  (df)  associated  with  the  precision  index  are, 


d£P  - 


(s> 


2!ic2.c2iq2i  2(  2  ,  q 

X  wr  rr  e  h  i 


df.  +  df-  +  df 


+  df  +  df  +  df,  +  dfp 
wr  rr  e  b  rr 


Bias  limits  for  the  pressure  measurement  are 

Bp  =  ±VB i2  +  B72  +  Be2  +  Bb2  +  Bp  2 


(V-25) 


(V-26) 


If  special  tests  are  not  performed  to  determine  the  overall  effect  of  the  data  acquisition 
and  reduction  processes,  then  each  of  the  elemental  errors  must  be  evaluated  as  in  Section 
III.  The  precision  index  for  the  pressure  measurement  would,  therefore,  be  calculated  as 
follows : 


- 


+  S„ 


(V-27) 


where  Si  =  the  root-sum-square  of  the  elemental  precision  errors 
in  the  calibration  hierarchy 

52  =  the  root-sum-square  of  the  elemental  precision  errors 

in  the  data  acquisition  process 

53  =  the  root-sum-square  of  the  elemental  precision  errors 

in  the  data  reduction  process 
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The  degrees  of  freedom  for  the  pressure  measurement  are 


jfP  - 


(v 


+  s„2  +  s02  +  s  _2  +  s  2 


+  s_  +  s. 


s  4  s4  s4  s4  s4 

1  2  3  wr  rr 

d?7  +  df7  +  JT  +  JT~  +  Jf~ 

i  2  3  wr  rr 


(V-28) 


+  IT  +  dT 


Bias  limits  for  the  pressure  measurement  are  calculated  as  the  root-sum-square  of  the 
elemental  bias  limits 


Bp  =  VB!2  +  B22  +  B32  +  be2  +  bb2  (V-29) 

5.3  TEMPERATURE  MEASUREMENT  ERROR  SOURCES 
5.3.1  Calibration  Hierarchy  Errors 

The  apex  of  the  calibration  hierarchy  is,  of  course,  the  NBS  as  indicated  in  Fig.  V-10. 


Fig.  V-10  Temperature  T ransducer  Calibration  Hierarchy 

The  NBS  certifies  platinum  resistance  thermometers  by  the  International  Practical 
Temperature  Scale  of  1968  (IPTS-68).  The  International  Practical  Temperature  Scale  is 
based  on  a  number  of  fixed  and  reproducible  equilibrium  temperatures  and  on 
internationally  agreed-upon  measuring  instruments  and  interpolation  formulas.  The  eleven 
primary  equilibrium  temperatures  and  a  few  secondary  temperatures  are  listed  in  Table  XIV. 
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Table  XIV  International  Practical  Temperature  Scale  of  1968 


Reference 

Temperature 

°C 

°K 

°F 

°R 

Freezing  Point  Gold* 

1064.43 

1337.58 

1947.97 

2407.64 

Freezing  Point  Silver* 

961.93 

1235.08 

1763.47 

2223.14 

Freezing  Point  Aluminum 

660.37 

933.52 

1220.67 

1680.34 

Freezing  Point  Antimony 

630.74 

903.89 

1167.33 

1627.00 

Boiling  Point  Sulfur 

444.674 

717.824 

832.413 

1292.083 

Freezing  Point  Zinc* 

419.58 

692.73 

787.24 

1246.91 

Freezing  Point  Lead 

327.502 

600.652 

621.504 

1081.174 

Freezing  Point  Tin 

231.9681 

505.1181 

449.5426 

909.2126 

Boiling  Point  Water* 

100. 

373.15 

212. 

671.67 

Triple  Point  Water* 

+0.01 

273.16 

32.02 

491.69 

Boiling  Point  Oxygen* 

-182.962 

90.188 

-297.332 

162.338 

Triple  Point  Oxygen* 

-218.789 

54.361 

-361.820 

97.850 

Boiling  Point  Neon* 

-246.048 

27.102 

-410.886 

48.784 

Boiling  Point  Hydrogen* 

-252.87 

20.28 

423.166 

36.50 

Boiling  Point  Hydrogen, 

-256.108 

17.042 

428.994 

30.676 

25/76  atm* 

Triple  Point  Hydrogen* 

-259.34 

13.81 

434.812 

24.86 

♦Indicates  IPTS-68  Defining  Temperature 


A  typical  calibration  report  from  the  NBS  reads  as  follows: 

Temperatures  between  0°C  and  630.74°C  on  the  new  International  Practical  Temperature 
Scale  of  1968  (IPTS-68)  are  defined  by  the  indications  (resistance  values)  of  standard  platinum 
resistance  thermometers  and  the  following  expressions: 


t  =  t'  +  M(t')  (1) 


where  t  is  the  temperature,  at  the  outside  of  the  tube  protecting  the  platinum  resistor,  in  °C  on 
the  International  Practical  Temperature  Scale  of  1968  and  Rt  and  R0  are  the  resistances  of  the 
platinum  resistor  at  t°C  and  0°C,  respectively,  measured  with  a  continuous  current  through  the 
platinum  resistor.  The  value  of  M(t'),  given  by  expression  (3),  is  the  same  for  all  thermometers 
and  is  a  function  only  of  the  quantity  t\  The  addition  of  the  small  value  represented  by  (3) 
serves  to  make  the  IPTS-68  conform  more  closely  to  the  thermodynamic  scale  than  can  be  done 
with  only  the  simple  quadratic  of  expression  (2). 

An  alternate  form  which  is  completely  equivalent  to  expression  (2)  is 

Rt  =  Rc(l  +  At'+  Bt'2)  (4) 
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In  some  instances  expression  (4)  is  less  difficult  to  calculate  than  (2).  The  constants  A  and  B 
used  in  (4)  are  related  directly  to  a  and  5. 


A  =  a(l  +  S/100) 

(5) 

B  =  -a5/ 10 4 

(6) 

CAUTION:  The  values  of  A,  B,  and  &  on  the  new  1968  scale  are  distinctly  different  from 
the  corresponding  values  on  the  old  1948  or  1927  scale.  The  values  of  a  and  R0  are  also 
different  but  only  trivially  so. 

Temperatures  below  0°C  on  the  new  1968  scale  are  calculated  using  a  standard  reference 
table  which  gives  values  of  Rt/R0  for  a  fictitious  "mean"  standard  thermometer.  This  reference 
table  and  a  specified  deviation  equation  are  combined  to  give  the  values  for  a  particular 
thermometer.  The  standard  reference  table  used  for  IPTS-68  is  referred  to  as  the  "CCT-68" 
table.  It  is  convenient  to  use  the  symbol  Wt  in  place  of  Rt/R0.  For  the  special  reference  values 
of  Rt/R0  tabulated  in  CCT-68,  the  special  symbol  Wt*  is  used.  The  table  giving  values  of  Wt  for 
a  particular  thermometer  from  0°C  down  to  -182.962°C  may  be  calculated  from  the  following 
expressions: 


w*  + 

wt 

(7) 

A4t;  + 

C4t3(t-  100) 

(8) 

Expression  (8)  is  the  specified  deviation  equation  in  the  range  0°C  to -182.962°C.  ... 

A  table  calculated  from  the  constants  for  this  thermometer  is  on  the  following  pages.  If  no 
value  for  C4  is  given,  the  table  below  0°C  was  calculated  with  an  assumed  value  of  this 
constant.  The  first  column  of  the  table  gives  values  of  temperature.  Unless  a  different  function 
is  requested,  the  second  column  gives  Rt/R0  (i*e.  the  ratio  of  the  instance  at  the  stated 
temperature  to  the  resistance  at  the  ice  point).  The  third  column  gives  the  inverse  (reciprocal) 
of  the  difference  between  successive  values  in  the  second  column.  These  reciprocal  first 
differences  are  included  to  facilitate  interpolation.  The  error  introduced  by  using  linear 
interpolation  will  be  less  than  0.0Q01°C. 

The  range  of  this  table  does  not  imply  that  this  thermometer  is  necessarily  a  satisfactory 
instrument  over  exactly  the  same  range.  The  range  was  selected  to  cover  an  interval  believed  to 
include  the  needs  of  the  majority  of  users  of  this  type  of  thermometer. 

Temperature  transducers  certified  by  this  procedure  by  the  NBS  exhibit  negligibly  small 
errors  when  compared  with  errors  associated  with  calibration  processes  below  the  NBS  level. 


Calibrations  of  transfer  standard  temperature  transducers  are  accomplished  by  placing 
the  transfer  standard  in  a  calibration  medium  along  with  the  interlab  standard  which  defines 
the  temperature  of  the  medium.  If  comparisons  are  made  between  the  interlab  standard  and 
transfer  standard  at  K  temperatures  and  the  process  is  repeated  at  specified  time  intervals,  a 
calibration  data  bank  will  be  established  from  which  calibration  precision  indices  and  bias 
limits  may  be  established,  i.e., 
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where  Sj  =  calibration  process  precision  index  at  temperature  j 

Xy  =  individual  temperatures  indicated  by  the  transfer 
standard  at  temperature  j 

Xj  =  the  average  indication  by  the  transfer  standard 
at  temperature  j 

N  =  number  of  indications  at  temperature  j 


(V- 30) 


( V-3 1 ) 


where  Sts  is  the  calibration  process  precision  index  for  the  transfer  standard.  The 
degrees  of  freedom  (dfTS)  are 


dfxs  =  K(N  -  1)  (V-3 2) 

Bias  limits  for  the  transfer  standard  calibration  process  should  be  estimated  on  the 
basis  of  interlab  and  interfacility  comparisons  and  engineering  judgment. 

Temperature  transducers  used  in  jet  engine  testing  are  usually  calibrated  against  a 
transfer  standard  transducer.  The  same  techniques  described  for  transfer  standards  are  used 
in  these  calibrations.  Comparisons  are  made  at  a  minimum  of  three  different  temperatures 
over  the  test  transducer  range  to  establish  conformance  with  the  manufacturer’s 
specifications.  If  the  manufacturer  specifies  limits  for  precision  error  and  bias,  the  precision 
index  for  the  transducer  is  the  precision  error  limit  divided  by  t  =  2.0,  i,e.,  if 

t95s-  =  ±0.36  (V-33) 


then 


Si  =  ±0.18  (V-33) 

where  t9  5  Si  is  the  specified  precision  error  limit  and  si  is  the  transducer  precision  index. 

The  degrees  of  freedom  (dfj)  associated  with  the  precision  index  are  assumed  to  be 
greater  than  30. 

Bias  limits  (Bj)  for  the  transducer  are  equal  to  the  limits  specified  by  the  manufacturer. 

If  extensive  calibration  histories  have  been  accrued,  it  may  be  advantageous  to 
calculate  the  precision  index  directly  from  calibration  data  rather  than  accept  the  values 
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provided  by  the  manufacturer.  The  manufacturer’s  specified  limits  will  likely  be 
conservative.  This  being  the  case,  the  precision  index  is  calculated  from 


where  St j  =  the  precision  index  for  N  transducers  at  temperature  j 

Xy  =  individual  indication  at  temperature  j  by  the  ith  transducer 
Xj  =  the  average  indication  at  temperature  j  by  all  transducers 
N  =  the  number  of  transducers  calibrated 


where  Sj  =  measurement  transducer  precision  index 

M  =  number  of  temperatures  at  which  comparisons  are  made 


(V-34) 


(V-35) 


The  degrees  of  freedom  for  this  calibration  process  are 


dfT  =  M(N-l)  (V-36) 

Bias  limit  estimates  are  left  to  the  judgment  of  the  instrumentation  engineer. 


The  precision  index  for  the  calibration  hierarchy  is 

sx  =  ±  ^sTS2  +  sT2 

The  degrees  of  freedom  for  Si  are 


dfl  = 


* 


c  2  c  2 

aTS  +  T 


)2 


TS  T 

dfTS  dfT 


(V-37) 


(V-38) 


The  bias  limit  for  the  calibration  hierarchy  is 

Bx  =  ±^Bts2  +  Bt2  (V-39) 

5.3.2  Data  Acquisition  and  Reduction  Errors 

Evaluation  of  the  overall  effect  of  data  acquisition  and  reduction  errors  is  best 
accomplished  by  monitoring  systems  or  special  tests  specifically  designed  for  this  purpose. 
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5.3.2. 1  Thermocouples 

A  reference  temperature  monitoring  system  will  provide  an  excellent  source  of  data 
for  evaluating  errors  due  to  the  recording  apparatus  and  data  reduction  process. 

Figure  V-l  1  depicts  a  typi¬ 
cal  setup  for  measuring  gas 
turbine  engine  gas  path  temper¬ 
atures  with  Chromel®-Alumel® 
thermocouples. 


If  several  calibrated  ther¬ 
mocouples  are  utilized  to  moni¬ 
tor  the  temperature  of  the 
reference  junction  block,  statis¬ 
tically  useful  data  can  be  re¬ 
corded  each  time  test  data  are 
recorded.  Assuming  that  those 
thermocouple  data  are  recorded  and  reduced  to  engineering  units  by  processes  identical 
to  those  employed  for  engine  temperature  measurements,  a  stockpile  of  data  will  be 
gathered,  from  which  data  acquisition  and  reduction  errors  may  be  estimated. 

For  the  purpose  of  illustration,  suppose  N  calibrated  Chromel-Alumel  thermocouples 
are  employed  to  monitor  the  reference  block  temperature  of  a  temperature  measuring 
system  similar  to  that  depicted  by  Fig.  V-ll.  If  each  time  a  test  data  point  is  recorded, 
multiple  scan  recordings  are  made  for  each  of  the  thermocouples  jmd  if  a  multiple  scan 
average  (Xy)  is  calculated  for  each  thermocouple,  then  the  average  (Xj)  for  all  recordings  of 
the  jth  thermocouple  is 

K 

X  x . 

X.  =  tlJL  (V-40) 

J  K 


Fig.  V-11  Typical  Thermocouple  Channel 


where  K  is  the  number  of  multiple  scan  recordings  for  the  jth  thermocouple. 
The  grand  average  (X)  is  computed  for  all  monitor  thermocouples  as 


X  = 


N  _ 

X  Xj 
j=i 

N 


(V-41) 


The  precision  index  (Sx)  for  the  data  acquisition  and  reduction  processes  is  then 


sx 


N  K  9 

x  x  (x..-  x.r 

i=i  i=i  1J  J 


N 

X  (K  -  1) 
j=l 


(V-42) 
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The  degrees  of  freedom  associated  with  Sx  are 

N 

dfx  =  Xi  (K  -  l)  (V-43) 

Bias  limits  for  the  data  acquisition  process  will  be  estimated  by  the  instrumentation  engineer. 
Error  sources  accounted  for  by  this  method  are: 

1 .  Ice  point  reference  precision  error 

2.  Reference  block  temperature  precision  error 

3.  Recording  system  resolution  error 

4.  Recording  system  electrical  noise 

5.  Analog-to-digital  conversion  error 

6.  Chromel-Alumel  thermocouple  millivolt  output 
versus  temperature  curve-fit  error 

7.  Computer  resolution  error 

Several  errors  which  are  not  included  in  the  monitoring  system  statistics  are 

1 .  Conduction  error  (Bc ) 

2.  Radiation  error  (BR) 

3.  Recovery  error  (By) 

4.  Calibration  error  (Bi ) 

These  errors  are  a  function  of  probe  design  and  environmental  conditions.  Detailed 
treatment  of  these  error  sources  is  beyond  the  scope  of  this  work.  Several  good 
references  which  should  provide  the  background  required  to  complete  an  error  analysis 
are  listed  below: 

1.  “A  Design  Procedure  for  Thermocouple  Probes,”  Laurence  B.  Haig,  General 
Motor  Corp.,  SAE  Preprint  158C,  SAE  National  Aeronautics  Meeting,  April 
1960. 

2.  “Experimental  Determination  of  Time  Constants  and  Nusselt  Numbers  for 
Bare- Wire  Thermocouples  in  High-Velocity  Air  Streams  and  Analytic  Approxi¬ 
mation  of  Conduction  and  Radiation  Errors,”  Marvin  D.  Scadron  and  Isidore 
Warshawsky,  NACA  TN  2599,  January  1952. 

3.  “Recovery  Corrections  for  Butt-Welded,  Straight-Wire  Thermocouples  in 
High-Velocity,  High-Temperature  Gas  Streams,”  Fredrick  S.  Simmons,  NACA 
RM  E54G22a,  September  1954. 
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4.  “Radiation  and  Recovery  Corrections  and  Time  Constants  of  Several 
Chromel-Alumel  Thermocouple  Probes  in  High-Temperature,  High-Velocity  Gas 
Streams,”  George  E.  Glawe,  Fredrick  S.  Simmons,  and  Truman  M.  Stickner, 
NACA  TN  3766,  October  1956. 

5.  “Performance  of  Three  High- Recovery-Factor  Thermocouple  Probes  for 

Room-Temperature  Operation,”  Marvin  D.  Scadron,  Clarence  C.  Gettelman,  and 
George  J.  Pock,  NACA  RM  E50I29,  December  1950. 

6.  “Recovery  Characteristics  of  a  Single-Shielded  Self- Aspirating  Thermocouple 

Probe  at  Low  Pressure  Levels  and  Subsonic  Speeds,”  C.  E.  Willbanks, 

AEDC-TR-71-68,  April  1971. 

5.3.2.2  Resistance  Thermometers 

One  tried  and  proved  procedure  for  evaluating  the  data  acquisition  and  reduction 
errors  associated  with  resistance  thermometer  temperature  measurements  is  as  follows: 

1.  Wirewound  resistors,  matched  to  ±0.01  percent  of  the  desired  value,  are 
substituted  in  place  of  resistance  thermometers. 

2.  With  the  exception  of  the  substitution  resistors,  the  temperature 

measurement  system  should  be  identical  to  that  used  during  engine  testing. 
Components  of  the  system  (Fig.  V-12)  are 

a.  Bridge  completion  network  (BCN)  e.  Signal  conditioning  equipment 

b.  Power  supply  f.  Analog-to-digital  converter 

c.  Recording  system  electrical  calibration  g.  Magnetic  tape  recorder. 

d.  Switching  components 


Power  Supply 

Fig.  V-12  Temperature  Data  Recording  Calibration 
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3.  Select  at  least  four  resistance  thermometer  channels. 

4.  Follow  normal  pre-run  procedures  for  setting  up  the  recording  system. 

5.  Make  several  (ten  or  more)  multiple  scan  (ten  or  more)  recordings. 

6.  Reduce  the  data  by  means  of  the  normally  used  gas  turbine  engine  data 
reduction  program  and  calculate  a  multiple  scan  average  (Xy)  for  each 
recording  of  each  channel.  The  average  (Xj)  for  all  recordings  on  the  jth 
channel  is 


2  x.. 

i=i  1J 


(V-44) 


where  =  the  number  of  recordings  on  the  jth  channel.  The  grand 
average  (X)  is  computed  for  all  channels: 


X  = 


N 

2  X 
j=l _ 

N 


(V-45) 


where  N  =  number  of  channels  tested. 

The  precision  index  (Sx )  for  the  data  acquisition  and  reduction  processes  is  then 


SX  - 


N  Mi  _  2 

2  2  (x..-  x  ) 

[  j=i  fai  1  1 

N 

X  (M.-  1) 
j=l  J 


(V46) 


me  degrees  of  freedom  associated  with  the  precision  index  are 


dfy  =  2  (M.-l) 
x  j=l  J 

Bias  limit  estimates  are  left  to  the  judgment  of  the  instrumentation  engineer. 


(V-47) 


The  only  error  sources  nov  accounted  for  are  bridge  completion  network  (BCN) 
environmental  effects  and  errors  resulting  from  the  dynamics  of  an  engine  test.  The  first 
will  be  accounted  for  if  the  BCN  environment  is  at  engine  test  conditions.  If  not,  then 
laboratory  tests  are  required  to  determine  the  effects  of  BCN  temperature  variations  on 
temperature  measurements.  Errors  resulting  from  the  dynamics  of  an  engine  test  are 
accounted  for  by  means  of  multiple  measurement  statistics.  From  multiple  measurements, 
the  pooled  within-run  precision  error  (Swr)  and  the  pooled  run-to-run  precision  error 
(Sri)  for  each  resistance  thermometer  may  be  obtained.  Derivations  and  formulation  for 
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calculating  Swr  and  Srr  are  in  Appendix  C.  If  thermometer  and  BCN  are  not  calibrated  as 
a  unit  (interchangeable  BCN’s)  then  a  third  multiple  measurement  statistic  (Scc)  must  be 
calculated.  This  statistic  is  referred  to  as  the  pooled  calibration-to-calibration  precision 
error.  Derivations  and  formulation  for  this  statistic  are  also  in  Appendix  C. 

5.3.3  Temperature  Measurement  Error  Summary 

5.3.3. 1  Thermocouples 

The  precision  index  for  temperature  measurements  made  with  thermocouples  is 

ST  =  ±^Sj2  +  S^2  +  Swr2  +  Srr2  (V48) 

where  Si  =  calibration  hierarchy  precision  index 

Sx  =  data  acquisition  and  reduction  precision  index 
Sw  r  =  within-run  precision  index  (multiple  measurements  only) 

Srr  =  run-to-run  precision  index  (multiple  measurements  only) 


The  degrees  of  freedom  associated  with  Sj  are 


dfT 


(si2  + 

v 


Sy2  +  s  2  + 

A  wr 


V  -V 

df  +  df  + 

2  wr 


Bias  limits  for  the  measurements  are 

Bx  =  i-y/Bj2  +  Bjj2  +  Bc2  +  Br2  +  By2 


where  Bi  =  calibration  hierarchy  bias  limits 

Bx  =  data  acquisition  and  reduction  bias  limits 
Be  =  conduction  error  bias  limits 
Br  =  radiation  error  bias  limits 
By  =  recovery  factor  bias  limits 

5.3. 3.2  Resistance  Thermometers 


(V-49) 


(V-50) 


The  precision  index  for  temperature  measurements  made  with  resistance 
thermometers  is 


-  ±\fs? 


S-2 


+  s- 


(V-5 1 ) 
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where  Si  =  calibration  hierarchy  precision  index 

Sx  =  data  acquisition  and  reduction  precision  index 

Swr  =  within-run  precision  index  (multiple  measurements  only) 

Srr  =  run-to-run  precision  index  (multiple  measurements  only) 

Scc  =  calibration-to-calibration  precision  index  (multiple 
measurements  only) 

se  =  BCN  environmental  effects  not  included  in  Sx 


The  degrees  of  freedom  df  associated  with  this  precision  index  are 


dfT  = 


(v 


+  s^2  +  s  2  +  s  2  +  s  2 

a  wf  rr  cc 


+  s 


e2)2 


11 

df 


S— 4 


s  4  s 

wr  rr 

.  +  dfc  +  df  +  d T 

1  A  wr  r 


cc 

+  —  + 


df 


Bias  in  the  temperature  measurement  is  estimated  by 


BT  =  +  yj  Bj2  +  Bx2  +  be 


where  be  is  the  bias  resulting  from  BCN  environmental  effects. 


(V-52) 


(V-53) 


If  special  tests  are  not  performed  to  determine  the  overall  effects  of  data  acquisition 
and  reduction  processes,  each  of  the  elemental  errors  must  be  evaluated  as  in  Section  III. 
The  precision  index  for  the  temperature  measurement  is  then 


-  Vs? 


s  2 


+ 


(V-54) 


where  Si ,  S2 ,  and  S3  are  the  root-sum-square  of  the  elemental  precision  errors  in  the 
calibration  hierarchy,  data  acquisition  process,  and  data  reduction  process,  respectively. 


The  degrees  of  freedom  for  the  temperature  measurement  are 


dfrp  = 


(S1 


2  +  S22  +  S32  +  S»t2  +  S„2  +  Scc2  +  S' 


s.4  s  4  s  4  s  4  s 

1  2  3  wr  rr 

dfT  +  dfT  +  dfT  +  df  +  dF 

1  2  3  wr  r 


cc  e 

+  IT"  +  dT 


(V-55) 


Bias  limits  for  the  temperature  measurement  are  calculated  by  root-sum-squaring  the 
elemental  biases. 


Bn 


(V-56) 
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SECTION  VI 
AIRFLOW 


6.1  GENERAL 

Airflow  rate  measurements  in  gas  turbine  engine  systems  are  generally  made  with  one 
of  three  types  of  flowmeters:  venturis,  nozzles,  and  orifices.  Selection  of  the  specific  type  of 
flowmeter  to  use  for  a  given  application  is  contingent  upon  a  trade-off  between 
measurement  accuracy7  of  requirements,  allowable  pressure  drop,  and  fabrication 
complexity /cost. 

Flowmeters  may  be  further  classified  into  two  categories:  subsonic  flow  and  critical 
flow.  With  a  critical  flowmeter,  in  which  sonic  velocity  is  maintained  in  the  flowmeter,  mass 
flow  rate  is  a  function  only  of  the  upstream  gas  properties.  With  a  subsonic  flowmeter, 
where  the  throat  Mach  number  is  less  than  sonic,  mass  flow  rate  is  a  function  of  both 
upstream  and  downstream  gas  properties. 

Equations  for  the  indicated  mass  flow  rate  through  nozzles,  venturis,  and  orifices  are 
derived  from  the  continuity  equation; 


W  =  PA\ 


(VI-1) 


where  W  =  mass  flow  rate,  lb /sec 

p  =  density  of  the  gas  at  the  meter  throat,  lb/ft3 
A  =  cross-sectional  area  of  the  throat,  ft2 
V  =  gas  velocity  at  the  throat,  ft/sec 


In  using  the  continuity  equation  as  a  basis  for  indicated  flow  equation  derivations,  it  is 
normal  practice  to  assume  conservation  of  mass  and  energy  and  one-dimensional  isentropic 
flow.  Expressions  for  indicated  flow  will  not  yield  the  actual  flow  since  actual  conditions 
always  deviate  from  ideal.  An  empirically  determined  correction  factor,  the  discharge 
coefficient  (Cd),  is  used  to  adjust  indicated  to  actual  flow: 


w 

w 


ac  tu  al 


indie  ate 


d 


(VI-2) 


Gas  flow  through  venturis  and  nozzles  closely  follows  the  contour  of  the  constriction, 
which  results  in  geometric  control  of  the  flow  area;  in  an  orifice,  the  flow  stream  is 
contracted  downstream  of  the  constriction  at  the  vena  contracta.  Location  and  size  of  the 
vena  contracta  (minimum  flow  area)  vary  with  flow  rate.  As  a  result,  flow  through  venturis 
and  nozzles  can  be  better  described  analytically,  and  therefore,  flow  measurements  made 
with  venturis  and  nozzles  are  potentially  more  accurate  than  flow  measurements  made  with 
orifices. 


7For  a  definition  of  terms  used  in  this  Handbook,  see  the  Glossary  in  Section  IX. 
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Since,  in  the  evaluation  of  turbine  engine  performance,  engine  inlet  total  airflow  is  one 
of  the  three  most  important  measurement  parameters,  the  requirement  for  high 
measurement  accuracy  generally  outweighs  all  other  considerations.  Hence,  it  is 
recommended  that  a  venturi  system,  operating  at  critical  flow  conditions,  be  used. 

In  the  sections  to  follow,  airflow  measurement  techniques  will  be  discussed  on  the 
basis  of  the  two  basic  systems:  subsonic  flowmeters  and  critical  flowmeters. 

6.2  AIRFLOW  RATE  MEASUREMENT  TECHNIQUES 

6.2.1  Subsonic  Flowmeters 


6.2. 1.1  Venturis  and  Nozzles 

Figure  VI- 1  schematically  depicts  a  representative  venturi  and  nozzle  design. 


Flow 


Measuring  Station  1 


Venturi 


Flow 


Fig.  VI-1  Schematic  of  Typical 
Venturi  and  Nozzle 
with  Measuring 
Stations 


Nozzle 


Flow  rates  through  subsonic  venturis  and  nozzles  may  be  calculated  by  means  of  Eq. 
(VI-3)  which  is  derived  from  the  continuity  equation. 
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77  cr 
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(VI-3) 


where 


4  f  Vt, 

W  =  airflow  rate,  lbm/sec 
d  =  meter  throat  diameter,  in. 

Q  =  meter  discharge  coefficient  (unitless) 

Fa  =  meter  thermal  expansion  correction  factor 

(unitless)  (evaluated  at  meter  skin  temperature) 

Pi  =  upstream  total  pressure,  lbf/in.2 
Ti  =  upstream  total  temperature,  °  R 
p2  =  throat  static  pressure,  lbf/in.2 
K  =  ratio  of  specific  heats  at  Ti  (unitless) 

M  =  molecular  weight  of  the  flowing  gas,  lbm/lbm-mol 
Z  =  compressibility  factor  (unitless) 

R  =  universal  gas  constant,  1545  ft  lbf/lbm-mol-0  R 
g  =  dimensional  constant,  32.174  lbm-ft/lbf-sec2 
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Equation  (VI-3)  is  a  general  expression  for  the  case  where  meter  upstream  total 
pressure  and  temperature  are  measured.  A  typical  example  of  this  type  of  measurement 
system  is  the  airflow  measurement  at  the  compressor  inlet  station  of  a  gas  turbine  engine  in 
the  flow  channel  (nozzle)  formed  by  the  engine  inlet  ducting  and  the  engine  inlet 
centerbody  or  spinner. 

It  should  be  noted  that  derivation  of  Eq.  (VI-3)  from  the  continuity  Eq.  (VI-1) 
requires  the  assumption  of  a  calorically  perfect  gas,  in  which  case  Z  =  1.  It  is  further 
assumed  that  the  upstream  total  temperature  (T*)  has  been  corrected  for  conduction, 
convection  and  radiation  losses  and  for  probe  recovery  factor,  as  specified  in  Section 
5.3.2. 1.  For  real  gases,  values  of  the  specific  heat  ratio  (K),  the  molecular  weight  (M),  and 
the  compressibility  factor  (Z)  are  a  function  of  the  gas  composition,  pressure,  and 
temperature.  The  equation  is  suitable  for  gases  normally  encountered  in  turbine  engine 
work;  the  value  of  K  should  be  evaluated  at  the  upstream  stagnation  conditions,  whereas  the 
value  of  Z  should  be  evaluated  at  the  meter  throat  static  conditions.  The  meter  discharge 
coefficient  (Q)  is  a  function  of  the  meter  construction,  the  measurement  and  calculation 
techniques,  and  the  gas  properties  at  the  meter  throat  station. 

Taylor’s  series  expansion  of  Eq.  (VI-3)  results  in  Eq.  (VI-4)  for  calculation  of  the 
precision  index  (Sw)  and  Eq.  (VI-5)  for  the  bias  limit  (Bw).  Errors  associated  with  values  of 
7r,  Fa,  K,  g,  i it,  Z,  and  R  in  Eq.  (VI-3)  are  assumed  negligible  in  the  following  calculations. 


Note  that  each  term  in  Eqs.  (VI-4)  and  (VI-5)  has  been  divided  by  W  to  simplify  the 
equations.  The  following  list  of  partial  derivatives  is  given  as  an  aid  for  the  analyst: 


dW 

<9d 


dW 
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In  Eqs.  (VI-4)  and  (VI-5),  it  is  assumed  that  Pi  and  p2  are  independent  measurements  on 
two  different  pressure  transducers.  If  Pi  is  measured  and  a  AP  equal  to  (Pi  -P2)  is 
measured,  Eqs.  (VI-4)  and  (VI-5)  reduce  to 


(VI-7) 


where 


dW/dP  1 
W 


<9W/<9AP 

W 


(VI-8) 


(VI-9) 


Several  recommended  practices  are  available  for  designs  of  subsonic  venturis  and 
flow  nozzles.  In  this  document,  the  ASME  recommended  practice  contained  in  “Fluid 
Meters,  Their  Theory  and  Applications,”  (6th  Edition,  1971)  will  be  used.  When  using  a 
specific  design  practice,  extreme  care  must  be  exercised  to  ensure  that  not  only  the  meter 
design,  but  also  the  measuring  systems,  meet  the^  recommended  practice,  since  the 
tabulated  values  of  meter  constants  apply  only  to  a  specific  combination  of  meter  design 
plus  measurement  technique. 

The  adiabatic  isentropic  equation  for  flow  of  an  ideal-compressible  fluid  through  a 
venturi  or  flow  nozzle  is  (from  the  cited  ASME  reference) 


(VI-10) 
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where  Wt  =  theoretical  weight  rate  of  flow 

a  =  meter  throat  area 
Pi  =  upstream  static  pressure 
P2  =  downstream  static  pressure 
7i  =  specific  weight  of  gas  at  station  1 
r  =  pressure  ratio,  P2/P1 
k  =  ratio  of  specific  heats,  cp/cv 
(3  =  ratio  of  throat  diameter  to  pipe  diameter 
g  =  dimensional  constant 


For  simplification,  an  adiabatic  expansion  factor  (Ya)  is  defined  as 


(VI-11) 


Values  of  Ya  are  graphically  presented  in  the  ASME  reference.  Substituting  Eq.  (VI-11)  into 
Eq.  (VI-10)  results  in 


Wt  =  a(Ya) 


2gy1(p1-p2) 


1-/3 4 


(VI-12) 


Applying  the  meter  discharge  coefficient  (C)  to  correct  indicated  flow  to  actual  flow 
and  the  area  factor  (Fa)  to  account  for  thermal  expansion  of  the  meter  throat  area  and 
rearranging  the  terms  of  Eq.  (VI- 12)  result  in  the  following  expression: 

Wt  =  ~J=  Ya  Fa\/2gy1(prp2)  (VI-13) 

Tni7 

where  d  =  meter  throat  diameter. 

Values  of  venturi  and  flow  nozzle  discharge  coefficient  are  graphically  presented  in  the 
ASME  reference. 

Expressing  the  gas  specific  weight  (7)  in  terms  of  measurable  parameters  of  pressure 
and  temperature,  accounting  for  gas  composition,  and  utilizing  the  gas  compressibility 
factor  (Z)  to  account  for  deviations  of  real  gases  from  an  ideal  gas  give 

PjM 

n  =  ^  (vi-i4) 
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where  pi  =  upstream  static  pressure 

M  =  gas  molecular  weight 

Z  =  gas  compressibility  factor 

R  =  universal  gas  constant 

Ti  =  gas  temperature,  corrected  for  losses 
and  probe  recovery  factor 

Substituting  into  Eq.  (VI-13)  and  utilizing  nomenclature  consistent  with  that  used  in 
Eq.  (VI-3)  result  in 


YaF0 


2gM 

ZR 


(VI-15) 


6.2. 1.2  Orifices 


As  with  venturis  and  nozzles,  several 
recommended  practices  exist  for  orifice 
designs.  A  typical  orifice,  with  measuring 
stations,  is  shown  schematically  in  Fig. 
VI-2. 


Measuring  Station  1  2 


n 


Fig.  VI-2  Schematic  of  Typical  Orifice  with 
The  ASME  recommended  practive  for  Measuring  Stations 

thin-plate  orifice  design  contained  in 

“Fluid  Meters,  Their  Theory  and  Applications,”  (6th  Edition,  1971)  will  be  utilized  in  this 
section.  Care  must  again  be  exercised  to  ensure  that  not  only  the  orifice  design  requirements 
are  met,  but  also  the  recommended  practice  for  pressure  and  temperature  measurements  are 
followed,  since,  for  thin-plate,  square-edged  orifices,  values  for  both  the  meter  expansion 
factor  and  the  discharge  coefficient  have  been  empirically  determined  for  the  specified 
meter  design  and  pressure  measurement  system. 


Flow  through  an  orifice  may  be  calculated  by  use  of  Eq.  (VI-15),  using  appropriate 
values  of  discharge  coefficient  (Q)  and  expansion  factor  (Y).  When  metering  gases  with 
venturi  tubes  or  flow  nozzles,  the  expansion  which  accompanies  the  change  in  pressure  takes 
place  in  an  axial  direction  only,  because  of  the  confining  walls  of  these  meters,  and  the 
adiabatic  expansion  factor  (Ya)  compensates  for  this  unidirectional  expansion.  With  a 
thin-plate  orifice,  there  are  no  confining  walls,  and  the  expansion  takes  place  both  radially 
and  axially.  To  account  for  this  multidirectional  expansion,  an  empirical  expansion  factor 
(Yi)  is  used.  Values  of  Yi  are  graphically  presented  in  the  ASME  reference.  For  all  the 
referenced  pressure  tap  locations  except  pipe  taps,  the  empirical  expression  for  the  orifice 
expansion  factor  is 


(VI-16) 
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where  P  =  ratio  of  orifice  diameter  to  pipe  diameter 

Pi  =  upstream  static  pressure 
p2  =  downstream  static  pressure 
k  =  ratio  of  gas  specific  heats 

Error  equations  for  orifices  when  upstream  static  pressure  is  measured  on  an 
absolute  transducer  and  AP  is  measured  on  a  differential  transducer  are  as  follows  (Errors 
associated  with  values  of  7r,  p,  Ya,  Fa,  g,  (jl,  Z,  and  R  in  Eq;  (VI-15)  are  assumed 
negligible  in  the  following  calculations.): 


The  Welch- Satterth waite  formula  must  be  used  to  determine  overall  degrees  of  freedom 
associated  with  Sw  .  If  the  degrees  of  freedom  are  greater  than  30  for  each  term  in  the  flow 
eiTor  equation,  the  overall  df  will  be  greater  than  30,  and  tg 5  =  2  is  used  in  the 
determination  of  flow  uncertainty : 


UW  =  ±(B  yj  +  2SW) 


6.2.2  Critical  Venturi  Flowmeters 

Figure  VI-3  schematically  depicts  a  representative  critical  venturi  flowmeter  installed  in 
the  inlet  ducting  upstream  of  a  turbine  engine.  Measuring  station  designations  used  in  this 
section  represent  AEDC  standard  practice. 


Fig.  Vl»3  Schematic  of  Critical  Venturi  Flowmeter  Installation 
Upstream  of  a  Turbine  Engine 

When  a  venturi  flowmeter  is  operated  at  critical  pressure  ratios,  i.e.,  Pin /Poo  is  a 
minimum,  the  flow  rate  through  the  venturi  is  a  function  of  the  upstream  conditions  only 
and  may  be  calculated  from 
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where 


W 


7T  d 


IN 


4  CdFaC* 


Vt, 


Wj  n  =  airflow  rate  through  venturi,  lbm/sec 
d  =  venturi  throat  diameter,  in. 

Q  =  meter  discharge  coefficient 
Fa  =  meter  thermal  expansion  correction  factor 
P00  =  upstream  total  pressure,  lbf/in.2 
T00  =  upstream  total  temperature,  °R 
C*  =  critical  flow  factor, 


(VI-19) 


(VI-20) 


K  =  ratio  of  specific  heats  evaluated  at  T0  0  (unitless) 
g  =  dimensional  constant,  32.174  lbm-ft/lbf-sec2 
R  =  universal  gas  constant,  1545  ft-lbf/lbm-mol  °R 
Z  =  compressibility  factor  (unitless) 

M  =  molecular  weight  of  flowing  gas,  lbm/lbm-mol 

The  indicated  upstream  total  temperature  measurement  must  be  corrected  for  thermal 
losses  and  probe  recovery  factor  as  discussed  in  Section  5.3.2.1 . 

For  a  venturi  designed  according  to  the  specifications  set  forth  in  ASME  Paper  No. 
61-WA-21 1,  the  value  of  Q  may  be  theoretically  determined  as  described  in  the  referenced 
paper. 

Equations  for  determination  of  precision  index  (S)  and  bias  limit  (B)  are  as  follows 
(Errors  associated  with  values  of  7r,  Fa,  and  C*  in  Eq.  (VI- 19)  are  assumed  negligible  in 
the  following  calculations.): 


SW1N  -  ±W1N 


+  -  S,  + 


'  -1  c 

l2T„„  Too/  VP 


+  U-  Y  (VI-21) 


and 


”  ~^1N 
W1N  iiN 


Vfe  b0  +  a Bj)2 + feB0 +  fcBp-) 


(VI-22) 


Again  the  degrees  of  freedom  will  be  determined  by  the  Welch- Satterth waite  formula. 
If  the  degrees  of  freedom  are  greater  than  30  for  each  error  term,  then  t9s  can  be  assumed 
equal  to  2. 
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The  reader  is  cautioned  about  two  pitfalls  common  to  gas  flow  measurement  with 
critical  flowmeters. 

1 .  Mass  flow  rate  is  a  function  of  upstream  total  pressure.  Therefore,  approach 
velocity  corrections  must  be  made  if  wall  static  pressure  measurements  are 
used.  As  a  rule,  if  the  velocity  is  maintained  at  50  ft/sec  or  less,  use  of  the 
isentropic  flow  relations  to  obtain  total  pressure  from  the  measurement  of 
wall  static  pressure  will  result  in  negligible  errors  in  flow  rate  determination. 

2.  It  is  essential  that  the  choked  condition  be  maintained  if  Eq.  (VI-19)  is  used 
to  calculate  airflow.  A  critical  flowmeter  can,  however,  be  operated 
subcritically;  in  this  event,  the  flow  rate  calculation  method  is  identical  to 
that  shown  by  Eq.  (VI-3)  using  the  venturi  throat  static  pressure  (Pin)  (Fig. 

VI-3)  for  the  p2  term  of  Eq.  (VI-3).  However,  the  uncertainty  of  the  airflow 
measurement  will  be  slightly  greater  than  for  the  case  of  critical  operation  of 
the  venturi. 

6.2.3  Calibration  Techniques 

Venturi,  nozzle,  and  orifice  calibrations  are  performed  to  determine  the  discharge 
coefficient. 

6.2.3. 1  Calibration  by  Calculation 

Discharge  coefficients  for  critical  flow  venturis  and  nozzles  can  be  calculated  with  an 
accuracy  greater  than  that  for  the  experimentally  determined  Cd  provided  that  the  design 
criteria  and  considerations  discussed  in  Section  6. 3. 1.1  are  adhered  to.  In  many  instances, 
determination  of  Cd  by  calculation  is  so  accurate  that  critical  venturis  are  considered 
primary  standards  when  associated  pressure  and  temperature  measurements  are  traceable  to 
the  NBS. 

6.2.3. 2  Experimental  Calibration 

Flowmeters  for  which  the  discharge  coefficient  cannot  be  accurately  calculated  may  be 
calibrated  experimentally  by  one  of  three  ways: 

1.  Flow  in  series  with  a  critical  venturi  for  which  the  Cd  can  be  accurately 
calculated. 

2.  Flow  a  known  volume  of  liquid  through  the  meter  at  fixed  temperature  and 
pressure  and  appeal  to  dynamic  similarity  to  translate  the  results  to 
compressible  flow. 

3.  Traverse  the  meter  with  a  pitot  static  probe  to  define  the  flow  profile.  The 
results  of  a  complete  traverse,  including  boundary  layer  measurements, 
constitute  a  flow  profile  which  will  yield  total  flow  when  integration 
beneath  the  profile  is  performed.  Definition  of  the  relationship  between 
total  flow  and  measured  pressures  and  temperature  constitutes  a  calibration. 
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6.2.3. 3  Calibration  by  Fabrication 

The  ASME  has  determined  the  discharge  coefficients  for  a  variety  of  flowmeters 
including  venturis,  nozzles,  and  orifices.  The  ASME  discharge  coefficients  have  been 
published  along  with  Cd  error  tolerances  in  the  ASME  publication  “Fluid  Meters,  Their 
Theory  and  Applications,”  (6th  Edition,  1971).  Care  must  be  taken  to  ensure  that  meter 
design  and  measurement  systems  conform  to  those  specified  by  the  ASME. 

If  a  flowmeter  does  not  comply  with  ASME  design  tolerances,  ASME  discharge 
coefficient  error  tolerances  do  not  apply,  and  calibration  is  required  for  flow  measurement 
uncertainty  analysis. 


6.3  ELEMENTAL  ERROR  SOURCES 


6.3.1  Discharge  Coefficient 

Discharge  coefficient  (Cd)  errors  of 
concern  are  primarily  biases,  and  the  sign 
is  unknown,  i.e.,  the  error  is  just  as  likely 
to  be  in  one  direction  as  the  other.  The 
error  distribution  will  probably  be  near 
normal  (Fig.  VI-4). 

The  values  of  Cd  may  exceed  one 
because  of  the  combination  of  measure¬ 
ment  error  and  calculation  technique  and 
the  assumptions  utilized  in  determining 


0.985  0.995  1.00 


Discharge  Coefficient, 

Fig.  VI -4  Discharge  Coefficient  Error 
Distribution 


the  value  of  discharge  coefficient.  The  best  value  of  Cd  to  use  for  data  reduction  is: 


and 


(VI-24) 

6.3.1. 1  Calculated  Cd 

Discharge  coefficients  for  critical  flow  venturis  may  be  calculated  provided  the  venturi 
design  conforms  to  criteria  set  forth  in  “A  Theoretical  Method  of  Determining  Discharge 
Coefficients  for  Venturis  Operating  at  Critical  Flow  Conditions,”  by  Robert  E.  Smith,  Jr., 
and  Roy  J.  Matz,  Journal  of  Basic  Engineering,  December  1962,  page  434,  ASME  Paper  No. 
61-WA-211.  Venturi  design  considerations  for  inlet  contour,  inlet  to  throat  area  ratio,  and 
throat  Reynolds  number  are  given  in  the  above  paper.  Errors  of  less  than  ±0.1  percent  will 
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result  from  assumptions  made  in  the  calculation.  This  error  is  considered  an  unknown  bias 
and  is  relatively  small  as  compared  with  errors  common  to  other  sources. 

6.3. 1.2  Experimentally  Determined  Cd 

Critical  flowmeters  which  do  not  fulfill  the  conditions  set  forth  in  Section  6.3.1 .1  must 
be  calibrated  experimentally  to  ensure  maximum  accuracy  in  Cd  determination. 

Three  common  methods  of  experimental  calibration  are  : 

1.  Comparison  with  a  critical  flow  standard. 

2.  Calibration  by  traversing  the  flowmeter. 

3 .  Liquid  calibration . 

6.3. 1.2.1  Comparison  with  a  Standard  Flowmeter 

Venturis,  nozzles,  and  orifices,  sonic  or  subsonic,  may  be  calibrated  in  series  with  a 
critical  flow  venturi  of  known  Cd . 

For  the  purpose  of  illustration,  assume  two  choked  venturis  in  series  (Fig.  VI-5)  and 
further  assume  that  the  inlet  flow  to  both  venturis  satisfies  the  criteria  set  forth  in  the 
ASME  paper  referenced  in  Section  6.3.1 .1 . 


Plenum  Plenum 


Fig.  VI-5  Calibration  by  Comparison 

Assume  that  the  Cd  for  venturi  A  has  been  calculated  with  a  bias  no  greater  than  ±0.1 
percent. 

The  mass  flow  rate  through  venturi  A  is 


W 


A  = 


(VI-25) 


The  mass  flow  rate  through  venturi  B  is 


(VI-26) 
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In  series,  Wa  =  Wb  ;  therefore,  the  two  equations  may  be  set  equal  to  each  other  and 
solved  for  the  product  dB  2  Cd  B .  Simplification  results  from  the  assumption  that  the  critical 
flow  factor  (C*)  is  equal  within  the  range  of  conditions  to  be  encountered  for  each  venturi. 
However,  if  dB  is  much  greater  than  dA ,  significant  real  gas  effects  may  be  experienced  in 
venturi  A.  Monitoring  the  temperature  of  each  meter  will  allow  thermal  expansion 
corrections,  and 


(VI-27) 


Expanding  Eq.  (VI-27)  in  a  Taylor’s  series  results  in  Eqs.  (VI-28)  and  (VI-29)  for  the 
precision  index  and  bias  limit,  respectively.  Errors  associated  with  values  of  FaA  and  Fafi 
are  assumed  negligible  in  the  following  calculations: 


s,  -c. 


B,  2C, 


±VcW(vSc0  +  (;*S) +  (poVSp4  +(p0'oB 


The  following  exam¬ 
ple  will  indicate  the 
effect  of  typical  errors  on 
discharge  coefficient 
determination  by  com¬ 
parison.  Table  XV  lists 
the  elemental  errors  as¬ 
sumed  for  this  example. 

Substituting  these 
values  into  Eq.  (VI-28) 
for  precision  index  and 
Eq.  (VI-29)  for  bias  limit 
gives 


Table  XV  Elemental  Errors  for  Calibration  by  Comparison 


Error 

Source 

Nominal 

Precision  Error, 
percent 

Bias  Error, 
percent 

Degrees  of 
Freedom 

C<U 

0.995 

0 

±0.1 

> 

30 

dA 

10.0  in. 

±0.01 

±0.01 

P°°A 

100.  psi 

±0.1 

±0.15 

PooB 

100.  psi 

±0.1 

±0.15 

Too  A 

600.  °R 

±0.16 

±0.08 

Toob 

600.  °R 

±0.16 

-'±0.08 

s  2r 

dB2Cdo 


±%/(0.00)2  +  4(0. 01)2  +  (0.1)2  +  (0.1)2  +  Va  (0.16) 2  +  Va  (0.16) 2 


±0.18  percent 


Bd  2Cd  _ _ 

— | - -  =  ±-x/  (0.1)2  +  4(0.01) 2  +  (0.15) 2  +  (0.15) 2  +  /.(0. 08) 2  +  ‘4(0. 08)2 

dB2caB 

=  ±0.24  percent 
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Since  each  of  the  elemental  degrees  of  freedom  is  greater  than  30,  the  overall  degrees 
of  freedom  are  also  greater  than  30;  tgs  =  2.0,  and 

U  =  ±[0.24  +  2(0.18)] 

=  ±0.60  percent 

Obviously,  determination  of  discharge  coefficients  by  this  method  is  less  accurate  than 
the  same  Cd  if  evaluated  by  calculation. 

Note  that  the  error  in  discharge  coefficient  evaluation  is  but  one  of  several  elemental 
sources  of  error  in  the  calculation  of  airflow. 

6.3.1. 2.2  Calibration  by  T raverse 

Flowmeter  discharge  coefficients  may 
also  be  determined  by  traversing  the  meter 
throat  with  a  pitot  static  probe  to  define  the 
meter  throat  mass-velocity  profile.  It  is 
recommended  to  traverse  several  meter  throat 
diameters,  equally  spaced  circumferentially, 
to  better  define  the  mass-velocity  profile.  The 
result  of  a  typical  four-diameter  traverse  is  an 
array  of  gas  stream  measurements  as  shown  in 
Fig.  VI-6.  For  convenience  the  measurement 
points  on  each  diameter  should  be  located  at 
the  centers  of  equal  area  annuli. 

For  the  general  case  of  airflow  measure- 
Fig.  VI-6  Flowmeter  Throat  Traverse  ment,  the  local  mass-velocity  is  a  function  of 

both  radial  and  circumferential  position: 

(pV)£  =  f(r,0)  (VI-30) 

and 

W  =  f2n  /'(pVOprdr  d9  (VI-31) 

o  o 

where  Wa  =  total  mass  flow  rate  through  meter  throat 

(pV)g  =  local  value  of  mass-velocity 

r  =  radial  location  of  local  measurement 
0  =  circumferential  location  of  local  measurement 

The  (pV)g  term  may  be  obtained  from  the  traverse  data  by  solving  Eq.  (VI-3)  for  flow 
rate  per  unit  area  and  using  the  local  values  of  throat  total  and  static  pressure  and  total 
temperature : 
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The  effect  of  a  variation  of  (pV)£ 
with  circumferential  position  in  the 
nozzle  throat  may  be  approximated  by 
averaging  the  local  mass-velocity  measure¬ 
ments  at  particular  radial  positions  (r) 
common  to  each  diameter  traversed.  An 
average  mass-velocity  profile  can  then  be 
developed  as  shown  in  Fig.  VI-7.  Care 
should  be  exercised  to  ensure  that 
boundary  layer  profiles  are  sufficiently 
defined. 


Fig.  VI-7  Flat  Mass-Velocity  Profile 


Integration  beneath  the  profile  defined  by  the  average  mass-velocities  provides  a 
measure  of  total  mass  flow  rate : 


wt  =  fA(pV)  rdA 

o 


where 


(VI-33) 


(VI-34) 


N  =  number  of  equally  spaced  circumferential 
measurements  taken  at  each  radial  position 

dA  =  incremental  flow  area  over  which  each  average 
mass-velocity  (pV)r  is  effective 


Mass-velocity  profile  errors  are  dominated  by  two  sources:  profile  distortion  and 
instrumentation  errors.  If  the  profile  is  distorted  (Fig.  VI-8)  the  cause  of  distortion  should 
be  diagnosed  and  corrected,  if  possible.  With  a  distorted  profile,  a  larger  number  of  diameter 
traverses  and  a  greater  number  of  points 
along  each  diameter  are  recommended  to 
precisely  define  the  existing  profile. 


Whether  the  profile  is  distorted  or 
undistorted,  a  valid  approximation  to  the 
total  flow  given  by  Eq.  (VI-33)  may  be 
obtained  by  summing  the  flows  calculated 
for  each  incremental  ring  area  (Ar)  as 
shown  below : 


R=i  R=i  _ 

wt  =  nR  =  x  (pv)  ar 

R= 1  R=1  r  K 


(VI-35) 


Fig.  VI-8  Distorted  Mass-Velocity  Profile 
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where  Wt  =  total  mass  flow  rate  through  meter  throat 

Wr  =  mass  flow  rate  through  each  incremental  ring 
(pV)r  =  average  mass-velocity  in  each  incremental  ring 
Ar  =  area  of  each  incremental  ring 
i  =  number  of  incremental  rings 

The  precision  index  for  each  incremental  flow  is  evaluated  by  expansion  of  Eq.  (VI-32) 
in  the  Taylor’s  series: 


S 


w 


R 


(VI-36) 


Fig  VI -9  Shaded  Area  Calculated  as 
a  Function  of  d-i  and  d2 


The  precision  index  S(^v)r  may  be  obtained 
as  previously  shown  in  Eq.  (VI4)  with  elimina¬ 
tion  of  the  meter  throat  area  terms  (Scd  and  Sd). 


The  precision  index  Sar  is  dependent  on 
the  repeatability  of  the  traverse  probe  radial 
position  indication  di  and  d2.  Figure  VI-9 
illustrates  this  dependence. 


"V  (dl2-d22> 

— - -  =  77-  - - - 


(VI-37) 


Taking  the  partials  with  respect  to  the  probe  radial  locations  gives 


(VI-38) 


where  Sdl  and  Sd2  are  the  precision  indices  for  the  respective  probe  radial  locations. 

The  precision  index  for  the  total  mass  flow  rate  determination  is  then 

Sw  -  (VI'39) 

The  airflow  bias  limit  BWr  cannot  be  calculated  directly  from  the  traverse  data.  This 
error  is  due  entirely  to  elemental  bias  errors  imposed  by  the  instrumentation  and  may  be 
estimated  by  the  use  of  Eq.  (VI-5)  and  dropping  the  terms  for  diameter  (d)  and  discharge 
coefficient  (Cd). 
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Solving  Eq.  (VI- 19)  for  Cd  in  the  case  of  a  critical  venturi  results  in 

4w1M*rf 

„  IN  \  oo 

L  i  =  - < - 

77(1 2  F  C*  P 

a  o  o 


(VI-40) 


Expanding  Eq.  (VI-40)  in  the  Taylor’s  series  results  in  Eq.  (VI-41)  and  (VI-42)  for  the 
precision  index  and  bias  limit,  respectively.  Errors  associated  with  values  of  n,  Fa,  and  C* 
are  assumed  negligible  in  the  following  calculations: 


The  degrees  of  freedom  (df)  associated  with  Sc  d  will  probably  be  greater  than  thirty  so 
that  tgs  will  equal  2.0.  If  this  is  not  obvious  then  df  must  be  calculated  using  the 
Welch-Satterthwaite  formula. 

Equation  (VI-3)  may  be  solved  in  similar  fashion  for  the  Cd  of  subsonic  meters. 
Expansion  in  the  Taylor’s  series  will  result  in  equations  for  the  precision  index  and  bias 
limits  for  subsonic  flowmeters. 

6.3.1. 2.3  Calibration  by  Liquid 

Venturi,  nozzle,  and  orifice  discharge  coefficients  may  be  evaluated  by  liquid 
calibration.  Methods  used  are  fully  analogous  to  those  detailed  in  Section  IV.  For  this 
reason,  the  treatment  of  errors  involved  with  this  calibration  technique  will  not  be  discussed 
here.  However,  the  reader  is  warned  that,  when  this  method  of  calibration  is  employed, 
published  data  on  expansion  factors  must  be  used  with  the  associated  errors  which  will  be 
reflected  in  the  discharge  coefficient.  Further,  an  appeal  to  dynamic  similarity  through  the 
Reynolds  analogy  is  required,  and  quantitative  assessment  of  the  uncertainty  of  the 
similarity  is  unavoidable. 
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6.3.1. 2.4  Calibration  by  Fabrication 

The  ASME  has  cataloged  discharge  coefficients  for  a  variety  of  venturis,  nozzles,  and 
orifices.  The  cataloged  values  are  the  result  of  an  extremely  large  number  of  actual 
calibrations  over  a  period  of  many  years.  The  results  of  this  experimental  work  is 
documented  in  the  ASME  publication,  “Fluid  Meters,  Their  Theory  and  Applications,”  (6th 
Edition,  1971).  Discharge  coefficients  cataloged  in  this  ASME  reference  are  applicable  to  all 
flowmeters  which  conform  to  this  specification.  Detailed  engineering  comparisons  must  be 
exercised  to  ensure  that  the  flowmeter  conforms  to  one  of  the  groups  tested  before  using 
the  tabulated  values  for  discharge  coefficients  and  error  tolerances. 

A  later  ASME  publication,  “A  Statistical  Approach  to  the  Prediction  of  Discharge 
Coefficients  for  Concentric  Orifice  Plates,”  by  R.  B.  Dowdell  and  Yu-Lin  Chen,  Paper  No. 
69-WA/FM-6,  may  be  useful  in  determining  which  Q  to  use  and  in  evaluating  errors 
associated  with  it. 

When  an  independent  flowmeter  is  used  to  determine  flow  rates  during  a  calibration 
for  Cd ,  dimensional  errors  are  effectively  calibrated  out.  However,  when  Cd  is  calculated  or 
taken  from  the  ASME  reference,  errors  in  the  measurement  of  pipe  and  throat  diameters 
will  be  reflected  as  bias  errors  in  the  flow  measurement. 

Dimensional  errors  in  large  venturis,  nozzles,  and  orifices  are  generally  negligible.  For 
example,  an  error  of  0.001  in.  in  the  throat  diameter  of  a  5-in.  nozzle  will  result  in  a  0.04 
percent  bias  in  airflow. 

6.3.2  Non- Ideal  Gas  Behavior  and  Variation  in  Gas  Compositions 

The  equations  given  in  preceding  sections  for  calculation  of  gas  flow  rate  (Eqs.  (VI-3), 
(VI-15),  (VI-19))  are  specifically  valid  for  any  calorically  perfect  gas.  Non-ideal  gas  behavior 
and  changes  in  gas  composition  are  accounted  for  by  selection  of  the  proper  values  for 
compressibility  factor  (Z),  molecular  weight  (M),  and  ratio  of  specific  heats'  (K)  for  the 
specific  gas  flow  being  measured. 

For  the  specific  case  of  airflow  measurement,  the  main  factor  contributing  to  variation 
of  composition  is  the  moisture  content  of  the  air.  Though  small,  the  effect  of  a  change  in  air 
density  due  to  water  vapor  on  airflow  measurement  should  be  evaluated  in  every 
measurement  process. 

6.3.3  Thermal  Expansion  Correction  Factor 

The  thermal  expansion  correction  factor  (Fa)  corrects  for  changes  in  throat  area  caused 
by  changes  in  flowmeter  temperature. 

For  steels,  a  30°F  flowmeter  temperature  difference,  between  the  time  of  a  test  and 
the  time  of  calibration,  will  introduce  an  airflow  error  of  0.06  percent  if  no  correction  is 
made.  If  flowmeter  skin  temperature  is  determined  to  within  ±5° F  and  the  correction  factor 
applied,  the  resulting  error  in  airflow  will  be  negligible. 
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6.3.4  Ratio  of  Specific  Heats  and  Compressibility  Factor 

The  ratio  of  specific  heat  (K)  at  constant  pressure  to  specific  heat  at  constant  volume 
(cp/cv  =  K)  and  the  compressibility  factor  (Z)  are  functions  of  gas  stream  composition, 
pressure,  and  temperature  and  may  be  obtained  from  gas  tables.  When  used  in  the  equations 
provided  for  calculation  of  flow  rate,  the  value  of  K  should  be  evaluated  at  upstream 
stagnation  conditions,  whereas  the  value  of  Z  must  be  evaluated  at  the  throat  static 
conditions. 

When  values  of  K  and  Z  are  obtained  at  the  stated  pressure  and  temperature 
conditions,  airflow  errors  resulting  from  errors  in  K  and  Z  will  be  negligible. 

6.3.5  Measurement  Systems 

i  j 

Errors  associated  with  pressure  and  temperature  measurements  and  their  respective 
probe  recovery  factors  are  described  in  Section  V. 

6.4  PROPAGATION  OF  ERROR  TO  AIRFLOW 

6.4.1  Critical-Flow  Venturi 


For  an  example  of  propagation  of  errors  in  airflow  measurement  using  a  critical-flow 
venturi,  consider  a  venturi  (designed  according  to  criteria  presented  in  ASME  Paper  No. 
61-WA-211)  having  a  throat  diameter  of  21.81  in.  operating  with  dry  air  at  an  upstream 
total  pressure  of  12.78  psia  and  an  upstream  total  temperature  of  478.7° R.  Equation 
(VI-19),  repeated  below,  is  the  flow  equation  to  be  analyzed: 


W 


Assume,  for  this  example,  that  the  theoretical  discharge  coefficient  (Cd)  has  been 
determined,  using  the  procedures  outlined  in  ASME  Paper  No.  61-WA-211,  to  be  0.995. 
Further  assume  that  the  thermal  expansion  correction  factor  (Fa)  and  the  compressibility 
factor  (Z)  are  equal  to  1.0.  Table  XVI  lists  nominal  values,  bias  limits,  precision  indices,  and 
degrees  of  freedom  for  each  error  source  in  the  above  equation. 

Note  that,  in  the  following  table,  airflow  errors  resulting  from  errors  in  Fa,  Z,  K,  g,  M, 
and  R  are  considered  negligible. 


117 


AEDC-T  R-73-5 


Table  XVI  Airflow  Measurement  Error  Source 


Error 

Source 

Nominal  Value 

Bias  Limit 

Precision 

Index 

df 

Uncertainty 

Poo 

12.78  psia 

±0.04  psia 

±0.02  psia 

15 

±0.08  psia 

Too 

478.7°R 

±1.8°R 

±0.20°Rr 

100 

±2.2°R 

d 

21.81  in. 

±0.001  in. 

±0.001  in. 

100 

±0.003  in. 

cd 

0.995 

±0.003 

... 

... 

±0.003  in. 

Fa 

1.0 

... 

... 

... 

Z 

1.0 

... 

... 

... 

... 

K 

1.401 

... 

... 

... 

... 

g 

32.174  lbm-ft/ 
lbf-sec2 

... 

— 

— 

— 

M 

28.95  lbm/lbm-mol 

... 

... 

... 

... 

R 

1545  lbf-ft / 

lbm-mol-°R 

... 

Equations  for  determination  of  precision  index  (S)  and  bias  limit  (B)  were  given  by 
Eqs.  (VI-21)  and  (VI-22): 


=  ±>/(0.0012)2  +  (-0.0002) 2  +  (9)  +  (0.000004) 2 


=  ±0.0012  =  ±0.12  percent 

Sw  =  ±0.12  percent  x  115.5  lbm/ sec  =  ±0.139  1  bn/ sec 
W1N 


=  ±  >/(0.0024)2  +  (-0.0018) 2  +  (0.003015) 2  +  (0.000004)2 


=  ±0.0046  =  ±0.46  percent 

Bw  =  ±0.46  percent  x  115.5  Hxn/ sec  =  ±0. 531  lbm/ sec 
W1N 
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By  using  the  Welch- Satterthwaite  formula,  Eq.  (1-11),  the  degrees  of  freedom  for  the 
combined  precision  index  is  determined  from 

(sP  2  +  sT  2  +  S/V 

_  \  oo _ 00 _ /_ 

-  SP  4  ST  4  S  4 

o  o  oo  d 

^  +  +  a?; 

0,0  o  o 

which  results  in  an  overall  degrees  of  freedom  >  30,  and  therefore  a  value  for  tg 5  of  2.0. 

Total  airflow  uncertainty  is  then, 

Uw 

iN  _  1  I  IN 
W  IN  \W1N 

=  ±[0.0046  + 

=  ±0.007  =  ±0.7  percent 

Uw  =  ±0.7  percent  x  115.5lbm/sec  =  ±0.81  lbm/ sec 

W1N 

6.4.2  Subsonic  Orifice 

Consider  a  2-in.  orifice  installed  in  a  4-in.  pipe  and  used  for  airflow  measurement.  The 
meter  is  a  square-edged  orifice  with  flange  taps,  and  the  value  for  Cd  has  been  taken  from 
the  ASME  references. 

Equation  (VI-15)  is  the 
flow  equation  to  be  analyzed. 

The  variables  to  be  considered 
are  d,  Cd,  Ap,  p1}  and  Ti. 

Indicated  total  temperature 
(Ti)  should  be  corrected  for 
losses  and  probe  recovery 
factor. 

From  the  ASME  refer¬ 
ences,  Cd  =  0.6025  ±  0.58%  (2 
sigma).  Table  XVII  lists  nomi- 
nals,  precision  indices  and  bias 
limits  for  each  error  source. 

From  Eqs.  (VI-17)  and  (VI- 18),  with  Sd  and  Scd  =0, 

SW  _  J(- 0.25  \  2  / 3  x  0.0 1\ 2  /— 0.04  V 

W  “  f\2(520)/  +  \2  x  5.0  /  +  \2  x  20.0/ 

=  0.0031714  =  0.32  percent 


Table  XVII  Airflow  Error  Source 


Error 

Source 

Nominal  Value 

Bias  Limit 

Precision  Index 

(S) 

d 

2.0  in. 

±0.001  in. 

— 

cd 

0.6025 

±0.0017 

... 

A 

5.00  psid 

±0.005  psid 

±0.010  psid 

PI 

20.00  psia 

±0.02  psia 

±0.04  psia 

Ti 

520.00  °R 

±1.00  °R 

±0.25  °R 

2(0.0012)] 
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=  0.0035194  =  0.35  percent 

If  the  overall  degrees  of  freedom  are  assumed  to  be  greater  than  thirty,  then 

+ 

=  ±(0.35  +  2  x  0.32)  =  ±0.99  percent 
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SECTION  VII 

NET  THRUST  AND  NET  THRUST  SPECIFIC  FUEL  CONSUMPTION 

7.1  GENERAL 

This  section  details  an  error  analysis  for  net  thrust  and  net  thrust  specific  fuel 
consumption  at  an  altitude  test  facility.  In  order  to  calculate  net  thrust,  engine  gross  (jet) 
thrust  must  first  be  determined.  Two  independent  techniques  for  the  determination  of 
gross  thrust  can  be  used:  (1)  external  forces,  or  scale  force  method  and  (2)  internal  forces, 
or  momentum  balance  method.  Both  techniques  are  utilized  for  most  gas  turbine  engine 
performance  programs  when  the  determination  of  net  thrust  and  thrust  specific  fuel 
consumption  is  a  primary  requirement.  Performance  determined  by  each  method  can  be 
compared  for  agreement  in  order  to  improve  the  confidence  in  thrust  data.  Error  analysis 
is  presented  only  for  the  external  forces  or  scale  force  method.  The  relationship  between 
gross  thrust  and  net  thrust  will  be  shown  in  Section  7.3. 

The  measurements  associated  with  the  determination  of  net  thrust  and  net  thrust 
specific  fuel  consumption  include  pressure,  temperature,  force,  fuel  flow,  and  airflow 
measurements.  Error  analysis  of  measurement  systems  have  been  presented  in  prior 
sections  as  follows:  temperature  and  pressure  measurements  (Section  V),  force 
measurement  (Section  III),  fuel  flow  measurement  (Section  IV),  and  airflow  measurement 
(Section  VI). 

7.2  GROSS  THRUST  MEASUREMENT  TECHNIQUES 
7.2.1  Scale  Force  Method 

The  engine  assembly  and  engine  support  mount  are  installed  on  a  thrust  stand  which 
is  flexure  mounted  on  a  model  support  cart.  The  engine  inlet  duct  system  contains  a 
zero-leakage,  labyrinth-type  air  seal.  Resultant  axial  forces  are  measured  by  a  strain-gage 
load  cell.  This  installation  permits  the  defining  of  a  control  volume  (Fig.  VII- 1)  which 
allows  the  calculation  of  gross  (jet)  thrust  (Fq)  from  easily  measurable  parameters.8 

The  freebody  diagram  associated  with  the  scale  force  method  of  thrust 
determination  is  shown  in  Fig.  VII- 1. 

The  derivation  of  gross  thrust  (Fq)  from  Fig.  VII-1  is 

*FX  =  0  -  +  AlPi  +  Fs  ~  Po  Z1  dA  -  .  AjPj 

Aj  s 

Rearranging  and  combining  terms  give 

WJVJ  .  ,  ,  WAlV!  A  , 

— —  +  AJ(PJ  -  Po)  “  — —  +  Al^Pl-Po)  +  Fs 


8For  a  definition  of  terms  used  in  this  Handbook,  see  Glossary  in  Section  IX. 
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WA1  =  engine  inlet  airflow  rate,  Ibm/sec 

=  engine  inlet  airflow  velocity,  ft/sec 

2 

g  =  dimensional  constant,  32.174  Ibm-f t/lbf-sec 

2 

A ^  =  engine  inlet  duct  cross-sectional  area  (OD) ,  in. 

2 

p^  =  engine  inlet  duct  static  pressure,  lbf/in. 

Fg  =  force  measuring  transducer  output  (scale  force) ,  lbf 

Wj  =  engine  exhaust  nozzle  exit  gas  flow  rate,  lbm/sec 

Vj  =  engine  exhaust  nozzle  exit  gas  flow  velocity,  ft/sec 

2 

Aj  =  engine  exhaust  nozzle  exit  area,  in. 

2 

Pj  =  engine  exhaust  nozzle  exit  static  pressure,  lbf/in. 

*  2 

pQ  =  free-stream  (ambient)  static  pressure,  lbf/in; 

Fig.  VI 1-1  Freebody  Diagram  for  External  Forces  (Scale  Force) 

Method  of  Determining  Engine  Gross  (Jet)  Thrust 

Engine  gross  (jet)  thrust  in  pounds  force  is,  by  definition, 

WJVJ 

fg  =  —  +  Aj<Pj-P„> 

therefore, 

W  Y 

Fc  -  +  Ai(Pi-Po>  +  Fs  (VII-1) 

O 

7.2.2  Momentum  Balance  Method 

The  momentum  balance  method  of  thrust  determination  utilizes  the  nozzle  throat 
total  pressure  and  temperature  profiles  obtained  with  a  traversing  probe  and  a 
mathematical  flow  field  integration  to  determine  the  nozzle  stream  thrust. 

Theoretical  calculations  utilized  in  the  momentum  balance  method  assume  the  fluid 
to  be  inviscid,  thermally  perfect,  and  non-heat-conducting.  The  method  of  calculation 
consists  of  direct  numerical  integration  of  the  equations  for  continuity,  momentum,  and 
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energy  to  define  the  gas  state  at  the  nozzle  throat.  The  gas  properties  at  the  nozzle 
throat  are  then  used  to  determine  the  exit  momentum  and  pressure-area  forces  required 
to  obtain  the  nozzle  stream  thrust. 

The  freebody  diagram  associated  with  the  momentum  balance  method  of  thrust 
determination  is  shown  in  Fig.  VII-2. 


VTH  =  8as  rate  at  nozzle  throat,  lbra/sec 

VTH  “  gas  velocity  at  nozzle  throat,  ft/sec 

g  “dimensional  constant,  32.174  lbm-f t/lbf-sec2 

2 

Atr  =  nozzle  throat  area,  in. 

2 

Pth  =  nozzle  throat  static  pressure,  lbf/in. 

Wj  =  gas  flow  rate  at  nozzle  exit,  lbm/sec 

Vj  =  gas  flow  velocity  at  nozzle  exit,  'ft/sec 

2 

Aj  =  nozzle  exit  area,  in. 

2 

Pj  =  nozzle  exit  static  pressure,  lbf/in. 

/  2 

Pw  =  nozzle  wall  static  pressure,  lbf/in. 

2 

Pq  =  free-stream  (ambient)  static  pressure,  lbf/in. 


Fig.  VII-2  Freebody  Diagram  for  Internal  Forces  (Momentum  Balance) 
Method  of  Determining  Engine  Gross  (Jet)  Thrust 

The  derivation  of  gross  thrust  from  Fig.  VII-2  is 


2F, 


TH 

THVTH^ 


r  TH  rJ  fwv  /  c 

d A  +  j  p "pjj  dA  +  ^|p^dA  —  J - — -  dA  —  I 


Pj 


dA 


TH 
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Engine  gross  (jet)  thrust  in  pounds  force  is,  by  definition, 

A  j  A  t 

fVj/g  f 

Fg  =  J— a— dA  +  J  PjdA  ~  AjP0 

o  o 

therefore, 

/ath  ath  aj 

WTHVTH/g  f  f 

- AEiL~dA+  J PTHdA  +  >WdA  -  AjPo  (VII-2) 

o  0  0 

7.3  PROPAGATION  OF  ERRORS  TO  NET  THRUST 

When  Fq  has  been  obtained  by  either  the  scale  force  or  the  momentum  balance 
method,  or  both,  identical  equations  are  used  to  obtain  net  thrust.  The  external  force 
(scale  force)  method  for  measuring  net  thrust  is  used  as  the  example,  and  the  derivation 
of  this  method  is  shown  in  Section  7.2.1.  The  Taylor’s  series  method  (Appendix  B)  of 
propagating  error  to  net  thrust  is  used. 

The  relationship  of  net  thrust  (Fn)  to  gross  thrust  (Fq)  is 

Fn  =  Fg  •-  Fa  (VII-3) 


where 


w  v 

FR  =  (VIM) 

n  g 

and  V0  is  the  aircraft  free-stream  velocity  in  ft/sec,  Wai  is  the  engine  inlet  airflow  rate  in 
Ibm/sec,  and  g  is  a  dimensional  constant.  Combining  Eqs.  (VII-1),  (VII-3),  and  (VIM) 
then  results  in  the  following  equation  for  engine  net  thrust: 


where 


fn  - 


A 1 


(Vi-V0)  +  A1(p1  -  po)  +  Fs 


(VII-5) 


(VII-6) 


(VII-7) 
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Pi  =  engine  inlet  duct  total  pressure,  lbf/in.2 
K  =  ratio  of  specific  heats  at  Ti 
R  =  gas  constant  for  air  at  Ti ,  ft-lbf/lbm-0  R 

All  other  parameters  are  as  designated  in  Fig.  VII- 1. 

Net  thrust  in  terms  of  pressure,  temperature,  area,  airflow,  a  gas  constant,  a  ratio  of 
specific  heats,  a  dimensional  constant,  and  force  measurement  now  becomes 


(VII-8) 


The  propagation  formulas  for  the  bias  limit  and  precision  index  are  derived  from  Eq. 
(VII-8)  for  Fn  . 


The  bias  limit  propagation  formula  is  the  weighted  root-sum-square  of  the  bias  limits 
for  WAi,  g,  R,  K,  Ti,  Pi,  pi,  p0,  Ai,  and  Fs : 


In  the  same  way,  the  precision  index  propagation  formula  is  the  weighted 
root-sum-square  of  the  precision  indices  of  Wa  i  ,  g,  K,  R,  Ti  ,  Pi  ,  pi ,  p© ,  Ai  ,  and  Fs  : 


Errors  associated  with  values  of  g,  K,  and  R  are  generally  assumed  negligible. 

The  uncertainty  for  net  thrust  (Fn)  is  calculated  using  the  uncertainty  formula: 

U  =  ±(B  +  t95S)  (VII-11) 

The  following  list  of  partial  derivatives  is  given  as  an  aid  to  the  analyst: 
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where 


dFT 


dw 


A  1 


2KgRT1 


K-l 


Bx2  -  B22 


dF* 


’  A 1 


dT , 


KgR 


'2  r  1 


(K-l)T. 


1-1 


Bx2  -  B22 


dA. 


~  Pi  "  Po 


dYf 

dFc 


=  1.0 


K-l 


<9F 


N 


dvQ 

dF 


=  W 


A1 


l\K/l\  K  /(K-1)RT1 
2gKBr 


-  A, 


K-l 


N 


dpr 

<9p. 


1\  K  /  1  \  K  /(K-DRT, 
2gKB  x 


Mil)  ft 


+  A, 


=  w, 


(K-l)RT 


A1  \  2gK 


1  (p.y 


1-2K 

K 


K-l  1> 


(pOKbi  2  -  (»«) 


K-l  1> 
Bf 


B,  -  i  -  ^ 


K-l 

K 


=  1  - 


K-l 

K 


By  using  Eqs.  (VII-9)  and  (VII- 10),  the  partial  derivative  equations  above,  and  the 
example  values  listed  in  Table  XVIII,  the  propagation  of  error  to  net  thrust  can  be 
determined. 

In  this  example,  values  for  the  partial  derivative  terms  above  were  approximated 
through  the  basic  net  thrust  equation.  First,  the  thrust  level  is  determined  from  the 
measured  values  using  performance  Eq.  (VII-8).  Then  each  measured  value  in  Eq.  (VII-8) 
is  changed,  independently,  by  the  amount  of  its  precision  index,  and  the  resulting  change 
in  Fn  is  obtained.  This  process,  repeated  for  each  measured  value,  provides  good 
approximate  numerical  values  for  each  term  in  Eq.  (VII- 10).  For  example  to  obtain  the 
approximate  value  for  the  term  [(9Fn/3Wai)Swa1]  of  Eq.  (VII-10),  determine  Fn  (Eq. 
(VII-8))  with  the  measured  values.  Then,  determine  the  change  in  Fn(AFn)  by  changing 
airflow  (WAi)  by  the  amount  of  its  precision  index.  The  change  in  Fn  resulting  from  the 
change  in  WAi  is  approximately  equal  to  the  term  [(3Fn/9WAi)Sw  a1  ] .  The  identical 
process  is  repeated  for  bias  limits  to  obtain  numerical  values  for  the  terms  in  Eq.  (VII-9). 
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Table  XVIII 

Typical  Measurement  and  Uncertainty  Values  Used  in  Net  Thrust  for 
Supersonic  Afterburning  T urbofan  Engine 

Flight  Condition:  30,000-ft  Altitude,  Mach  Number  0.9,  Military  Power 


Nominal 

Bias 

Precision 

Uncertainty, 

Degrees  of 

Component 

Value 

Limit 

Index 

U 

Freedom** 

Fs,  Scale  Force,  lbf 

4,388 

7.90 

3.95 

15.80 

105 

.  lbm  -  ft 

g,  Dimensional  Constant,  lbf  _  sec2 

32.174 

* 

* 

* 

* 

A* ,  Inlet  Duct  Area  (OD),  in.2 

984 

0.050 

0.050 

0.160 

12 

pi ,  Inlet  Duct  Static  Pressure,  psia 

6.50 

0.0065 

0.0065 

0.0202 

15 

pG,  Free-Stream  Static  Pressure,  psia 

4.31 

0.0099 

0.0099 

0.0310 

15 

R,  Gas  Constant  for  Air  at  Ti ,  lbm  .  ^ 

53.329 

* 

* 

* 

* 

Ti,  Inlet  Duct  Total  Temperature,  °R 

477 

±2.48 

±0.19 

±2.86 

100 

K,  Ratio  of  Specific  Heats  at  Ti 

1.4034 

* 

* 

* 

* 

Pi ,  Inlet  Duct  Total  Pressure,  psia 

7.43 

±0.0074 

±0.0111 

±0.0312 

15 

Wf ,  Total  Fuel  Flow,  lbm/hr 

4662 

±6.06 

±5.13 

±16.32 

35 

♦Bias,  precision,  and  uncertainty  considered  as  negligible  in  thrust  uncertainty. 
♦♦Degrees  of  freedom  determined  by  the  Welch-Satterthwaite  formula  (Eq.  1-11). 


By  using  Eqs.  (VII-6),  (VII-7),  and  (VII-8)  and  the  measurement  values  and  their 
uncertainty  components  listed  in  Table  XVIII,  the  propagation  of  error  to  V0,  Vi,  Fr, 
Fn,  and  TSFC  are  shown  in  Table  XIX.  Wax  of  Table  XIX  was  obtained  from  Section 
VI. 


Table  XIX 

Derived  Measurement  Uncertainty  Values 


Parameter 

Nominal 

Bias 

Limit 

Precision 

Index 

Uncertainty 

Degrees  of 
Freedom 

V0,  Free-Stream  Velocity,  ft/ sec 

908.4 

±3.049 

±2.119 

±7.414 

26 

Vi ,  Inlet  Duct  Velocity,  ft/sec 

463.4 

±2.684 

±3.057 

±8.981 

26 

Waj ,  Inlet  Duct  Airflow,  lbm/ sec 

115.5 

±0.531 

±0.139 

±0.825 

16 

Fr,  Ram  Drag,  lbf 

3261. 

±18.563 

±8.559 

±35.681 

38 

Fn,  Net  Thrust,  lbf 

4945 

±12.498 

±7.471 

±27.440 

59 

TSFC,  Net  Thrust  Specific  Fuel 
Consumption,  lbm/lbf-hr 

0.943 

±0.0027 

±0.0018 

±0.0063 

94 

127 


AEDC-TR-73-5 


7.4  PROPAGATION  OF  ERROR  TO  NET  THRUST' SPECIFIC  FUEL  CONSUMPTION 

TSFC  =  (VIM  2) 

Fn  lbf 

where  Wp  is  total  engine  fuel  flow  (lbm/hr),  and  Fn  is  net  thrust  (lbf). 

The  error  analysis  for  fuel  flow  is  shown  in  Section  IV,  and  the  error  analysis  for 
net  thrust  is  shown  in  Section  7.3. 


The  bias  limit  propagation  formula  is  the  root-sum-square  of  the  bias  limits  for  Wp 
and  Fn  weighted  by  the  partial  derivatives  (Appendix  B): 


R  ^  _  4. 

dTSFC  ~  - 


(dTSFC 


Bn 


dTSFC  0 

-  Hr 


IdF 


(VII-13) 


In  the  same  way,  the  precision  index  is  calculated  as  the  root-sum-square  of  the 
precision  indices  for  Wp  and  Fn  : 


TSFC 


dTSFC 

dwF 


+ 


dTSFC 
(9fn 


(VII-14) 


The  partial  derivatives  for  the  terms  in  Eqs.  (VII-13)  and  (VII-14)  are 

dTSFC  1  ,  dTSFC  WF 

awF  -  FN  and  5FN  -  -  Fn2 

Equations  (VII-13)  and  (VII-14)  are  now  evaluated  using  the  above  partials  and  the 
measurement  values  and  uncertainty  components  from  Tables  XVIII  and  XIX  for  Wp  and 
Fn  ,  respectively. 

BTSFC  =  ±V[(0.0002022)(6.06)]2  +  [(0.0001906)(12.498)]2 
=  ±0.0027  lbm/hr/lbf 


STSFC  =  ±  V[(0. 00020  22)(5. 13)] 2  +  [(0.0001906)(7.471)]2 
=  ±  0.0018  lbm/hr/lbf 


The  uncertainty  for  TSFC  is  calculated  using  the  uncertainty  formula: 

U  =  ±(B  +  t95S) 

Here  t9  5  is  =  2.0  since  the  degrees  ot  freedom  are  greater  than  30. 

U  =  ±[0.0027  +  2(0.0018)] 

=  ±  0.0063  lbm?hr/lbf 
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SECTION  VIII 
SPECIAL  METHODS 


8.1  GENERAL 

This  section  treats  several  methods  for  special  situations  or  conditions: 

1 .  Measurement  uncertainty9  for  multi-engine  installation  (similar  engines). 

2.  Measurement  uncertainty  for  the  single  stand,  single  engine  process  in 
comparison  with  the  many  stand,  many  engine  process. 

3.  Confidence  interval  for  uncertainty  when  biases  are  negligible. 

4.  Compressor  efficiency  error  analysis. 

5.  How  to  interpret  uncertainty. 

6.  Dynamic  measurement  uncertainty. 

8.2  MEASUREMENT  UNCERTAINTY  FOR  MULTI-ENGINE  INSTALLATIONS 
(SIMILAR  ENGINES) 

8.2.1  General 


The  uncertainty  in  performance  parameters  for  the  multi-engine  aircraft  for  similar 
engines  is  a  function  of  bias  limits  and  precision  indices  of  the  individual  engines  for 
those  performance  parameters.  If,  for  example,  the  parameter  of  interest  is  thrust,  the 
total  thrust  (Fj)  for  the  aircraft  is  the  sum  of  the  thrust  values  for  the  individual 
engines.  The  precision  index  (SpT)  for  total  thrust  is  the  root-sum-square  of  the  precision 
indices  (Si)  for  the  individuals  (assuming  that  the  engine  run-to-run  variance  is  negligible) 
and  where  Si  is  the  same  for  all  engines: 

SF  2  =  Is.2  =  KS;2 

or  T  i=1 

sFt  =  SiVK  (VIII-1) 


where  K  is  the  number  of  engines.  The  degrees  of  freedom  (df)  associated  with  a 
production  engine  facility  would  exceed  30  in  almost  every  case.  The  df  is  calculated 
from  the  degrees  of  freedom  (dfi)  for  each  engine. 

2 


df  = 


Kdfj  >  30 


(VIII-2) 


9For  a  definition  of  terms  used  in  this  Handbook,  see  the  Glossary  in  Section  IX. 
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The  bias  limit  (B)  for  the  installation  is  the  sum  of  the  bias  limits  (Bj)  for  each  of  the 
engines : 


K 

B  =  2  B.  =  KBj  (VIII-3) 

The  bias  limits  are  added  rather  than  root-sum-squared  because  the  bias  errors  for  similar 
engines  are  not  usually  independent.  (If  the  bias  errors  are  independent,  the  bias  limits 
may  be  root-sum-squared.)  Therefore,  these  ^errors  do  not  tend  to  cancel,  and  the  limit  is 
best  estimated  as  the  sum  of  the  limits.  [This  is  consistent  with  the  philosophy  that 
independent  bias  limits  are  combined  by  root-sum-squaring]  Finally,  the  uncertainty  for 
the  installation  can  be  calculated: 

U  =  ±[KB;  +  (t95)S;VK]  (VIII-4) 

where  t95  is  the  student’s  “t”  value  for  95  percent  (two-tailed)  confidence  and  df*  times 
K  are  the  degrees  of  freedom. 

8.2.2  Example  of  a  Four-Engine  Installation 

Suppose  an  aircraft  installation  consists  of  four,  20,000-lb-thrust  engines,  each  with 
the  following  reported  measurement  uncertainty: 

Bias  limit  ±36  lb  df  27.8 

Precision  limit  ±75  lb  Uncertainty  ±190  lb 

The  precision  index  for  the  installation  is  calculated  from  Eq.  (VIII-1): 

SF  =  ±(75)VT  =  ±(75)(2)  =  ±150.0 

T 

The  degrees  of  freedom  (Eq.  (VIII-2))  for  the  precision  index  are  27.8  x  4  =  1 1 1.2.  The  bias 
limit  (Eq.  (VIII-3))  for  the  installation  is  4  times  (±36)  =  ±144.  The  uncertainty  limit 
(Eq.  (VIII-4))  for  the  cluster  is 

U  =  +(144  +  t95  x  150)  =  +[144  +  2(150)3  =  +444  lb 

Since  the  degrees  of  freedom  exceed  30,  t95  =  2.0  is  used. 

8.3  MEASUREMENT  PROCESSES 

The  measurement  uncertainty  estimate  is  a  function  of  a  specific  measurement 
process.  In  this  section,  two  different  but  related  processes  are  discussed.  The  models 
illustrate  extremes:  many  tests  over  a  long  period  of  time  versus  two  tests  over  a  short 
time  interval.  In  the  paragraphs  that  follow,  the  general  model  for  many  engines  and 
many  test  stands  is  contrasted  with  the  model  for  back-to-back  development  testing  of  a 
single  engine  on  a  single  stand. 
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Note  that  in  the  following  examples  the  engine  hardware,  instrumentation,  and  test 
stand  might  be  identical  but  that  the  uncertainties  are  different  because  the  measurement 
of  interest  is  different. 

8.3.1  Many  Stand,  Many  Engine  Model 

The  general  process,  which  was  defined  in  Section  1 .7  and  discussed  throughout  this 
Handbook,  pertains  to  the  measurement  process  defined  for  many  sets  of  measurement 
instruments,  many  test  stands,  many  calibrations,  and  many  months  of  operation.  An 
example  is  the  measurement 
of  TSFC  at  an  engine 
production  facility.  The 
problem  is  to  determine  the 
absolute  level  of  perfor¬ 
mance. 

The  uncertainty  for 
this  measurement  process  is 
U  =  ±(B  + 19  5  S),  where  B  is 
the  root-sum-square  of  all 
elemental  bias  limits  and  S  is 
the  root-sum-square  of  all 
elemental  precision  indices 
for  the  process.  For  exam¬ 
ple,  Table  XX  lists  the 
elemental  errors  for  a  measurement  system  with  six  error  sources.  The  root-sum-square  of 
the  bias  limits  is  ±0.9.  The  root-sum-square  of  the  precision  indices  is  also  ±0.9.  The 
uncertainty  of  the  general  process  is  ±2.7. 

8.3.2  Single  Stand,  Single  Engine  Model 

During  a  gas  turbine  development  program,  many  tests  are  devoted  tp  evaluating 
new  component  designs.  The  objective  is  to  obtain  the  most  accurate  determination  of 
the  incremental  change  in  performance  between  the  baseline  and  the  new  configuration. 

The  engine  (or  rig)  is  installed  on  a  test  stand,  and  a  baseline  calibration  is 
performed.  Then,  an  engine  design  change  is  made  without  modification  to  the  stand  or 
instrumentation.  Typically,  these  changes  may  be  made  without  removing  the  engine 
from  the  test  stand.  For  example,  the  inlet  guide  vanes  might  be  replaced  or  compressor 
stator  vane  angles  adjusted.  Then,  the  engine  is  tested  again,  and  performance  is  measured 
for  comparison  with  the  baseline  calibration.  The  measurement  is  the  difference  between 
corresponding  performance  values  for  the  two  tests.  The  difference  should  be  due  to  only 
three  causes:  instrumentation  precision  error,  engine  repeatability  (which  has  been 
assumed  to  be  negligible),  and  the  design  change.  Since  the  repetitive  tests  are  confined 
to  a  single  set  of  instruments  and  a  single  engine,  the  measurement  uncertainty  is 
reduced;  bias  errors  are  not  considered  because  they  will  be  the  same  for  each  test  and 
will  not  affect  the  comparison.  The  only  errors  which  need  to  be  considered  are  the 


Table  XX  A  Measurement  System  with  Six  Error  Sources 


Source 

Bias 

Limit 

Precision 

Index 

Uncertainty 

NBS,  Interlab  Standard 

±0.1 

±0.1 

±0.3 

Interlab,  Transfer  Standard 

±0.1 

±0.1 

±0.3 

Transfer,  Working  Standard 

±0.5 

±0.5 

±1.5 

Working,  End  Instrument 

±0.5 

±0.5 

±1.5 

Calibration  Hierarchy  Error 

±0.72 

±0.72 

±2.16 

Data  Acquisition 

±0.5 

±0.5 

±1.5 

Data  Reduction 

±0.2 

±0.2 

±0.6 

Combined  Error 

±0.9 

±0.9 

±2.7 
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run-to-run  precision  errors  of  the  measurement  system  for  each  of  the  runs.  For  the  data 
in  Table  XX,  the  precision  index  of  the  data  acquisition  is  0.5  and  reduction  processes  is 
0.2  for  each  run.  The  uncertainty  must  be  calculated  for  the  difference  in  the  two  runs. 
It  is  the  root-sum-square  of  the  run-to-run  precision  error  of  the  data  acquisition  and 
reduction  precision  error  for  each  run : 


^  ^95  run  one  +  ^run  two  ^95  \  ^data  acq  +  ^data  red  +  ^data  acq  +  ^data  red 

=  t95V2(0.52  +  0.22)  =  2V^V0^29  =  1.523 
where  t95  =  2.0. 

8.4  CONFIDENCE  INTERVAL  WHEN  BIASES  ARE  NEGLIGIBLE  OR  CAN  BE 

IGNORED 

When  the  bias  is  very  small  (negligible)  or  can  be  ignored,  i.e.,  as  in  a  back-to-back 
development  test,  the  uncertainty  parameter  (U)  becomes  a  statistical  confidence  interval. 

The  interpretation  and  the  use  of  the  uncertainty  parameter  are  not  changed.  However, 
it  is  now  defined  with  known  exact  characteristics.  An  uncertainty  limit  of  six  pounds  force 
means  that  it  would  be  “reasonable  to  expect”  that  the  true  value  would  be  within  six 
pounds  force  of  the  measured  value.  For  95  percent  confidence  intervals,  95  percent  of  the 
intervals  will  contain  the  true  value.  The  qualitative  concept  “reasonable  to  expect”  is 
quantified  by  the  confidence  concept.  It  is  not  necessary  to  distinguish  between 
uncertainty  intervals  with  and  without  bias  errors.  The  same  simple  interpretation  of 
uncertainty  applies. 

As  an  example  of  a  confidence  interval,  take  the  following  measurement  data  for 
specific  fuel  consumption  for  a  10,000-lbf  gas  turbine  engine: 

Specific  Fuel  Consumption  =  0.88 
Bias  Limit  =  0.0 

Precision  Index  (S)  =0.02 

Degrees  of  Freedom  =25.2 

The  point  estimate  or  unbiased  estimate  of  specific  fuel  consumption  is  0.88.  The 
uncertainty  (U)  is  a  95  percent  confidence  interval  estimate: 

U  =  ±t95  x  0.02  =  +0.041 

That  is  the  95-percent  confidence  interval  is  0.88  ±  0.041  or  0.839  to  0.921.  In  repeated 
sampling,  such  an  interval  will  contain  the  true  value  with  9 5 -percent  frequency. 
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8.5  COMPRESSOR  EFFICIENCY  ERROR  ANALYSIS 
8.5.1  General 


Consider  a  compressor  efficiency  uncertainty  analysis  for  the  many  stand,  many 
compressor  model  and  the  single  stand,  single  compressor  model.  For  each  analysis,  Eq. 
(VI II -5)  is  used  for  the  calculation  of  adiabatic  efficiency  (t?)  of  a  compressor  as  a 
function  of  the  pressure  and  temperature  ratios  across  the  compressor: 


(VIII-5) 


where  P0  =  inlet  pressure 

Pi  =  exit  pressure 
T0  =  inlet  temperature 
Ti  =  exit  temperature 
K  =  ratio  of  specific  heats 


The  nominal  values  and 
elemental  bias  limits  and  preci¬ 
sion  indices  are  listed  in  Table 
XXI.  These  data  imply  a  pres¬ 
sure  ratio  of  6.5,  inlet  and 
exhaust  temperatures  of  530  and 
960aR,  and  efficiency  of  85 
percent. 

8.5.2  The  General  Process 

Many  compressors  are 
tested  in  many  rigs  with  many 
instrumentation  setups  over  a 
period  of  years. 

The  measurement  uncer¬ 
tainty  for  this  process  is  the 
uncertainty  associated  with  the 
absolute  level  of  performance 
for  a  compressor.  The  interval 
includes  all  the  bias  errors  and 
precision  measurement  errors 
associated  with  compressor  effi¬ 
ciency  calculation.  All  of  the 
error  estimates  listed  in  Table 
XXI  contribute  to  the 
uncertainty. 


Table  XXI  Tabulation  of  the  Elemental  Errors 


Source 

Bias  Limit 

Precision  Index 

T0Nominal,  530°R 

Thermocouples  at  530°R 

0.0°F  to  +0.10°F 

0.20°F 

Reference 

-0.1 0°F  to  +0.1 0°F 

0.10°F 

Signal  Conditioning 

-0.10°F  to  +0.10°F 

0.50°F 

Data  Reduction 

Negligible 

Negligible 

Combining 

-0.14°F  to  +0.1 7°F 

0.55°F 

Tj  Nominal,  960° R 

Thermocouples 

0.0°F  to  +1.00°F 

0.50°F 

Reference 

-0.1 0°F  to  +0.1 0°F 

0.10°F 

Signal  Conditioning 

-0.10°F  to  +0.1 0°F 

0.50°F 

Data  Reduction 

Negligible 

Negligible 

Combining 

-0.14°F  to  +1.01°F 

0.714°F 

PQ  Nominal  14.696  psia 

Transducers 

±0.1%  ~0.015  psia 

0.15%  ~  0.022  psia 

Recovery  Factor 

Negligible 

Negligible 

Signal  Conditioning 

±0.1%  ~0.015  psia 

0.10%  ~  0.0 15  psia 

Data  Reduction 

Negligible 

Negligible 

Combining 

±0.14%  ~  0.021  psia 

0.18%  ~ 0.027  psia 

Pj  Nominal  95.524  psia 

Transducers 

±0.10%  ~  0.10  psia 

0.15%  ~0.14  psia 

Recovery  Factor 

±0.10%  ~0.10  psia 

Negligible 

Signal  Conditioning 

±0.10%  ~0.10  psia 

0.10%  ~0.10  psia 

Data  Reduction 

Negligible 

Negligible 

Combining 

±0.17%  ~  0.1 73  psia 

0.18%  ~0.17  psia 

Degree  of  freedom  is  assumed  >30. 

K  is  ratio  of  specific  heats,  Nominal,  1.39,  errors  negligible. 
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For  each  of  the  four  values  T0,  Ti,  P0,  and  P1}  the  elemental  bias  limits  are 
root-sum-squared  and  the  elemental  precision  indices  are  root-sum-squared.  Table  XXII 
presents  a  summary 
of  the  combined  bias 
limits  and  precision 
indices  from  Table 
XXI. 

The  errors  in 
T0,  Ti,  P0,  and  Pi 
are  propagated  to 
efficiency  using  the 
Taylor’s  series  meth¬ 
od  described  in  Appendix  B.  The  appropriate  calculations  for  the  propagation  are 


Table  XXII  Summary  of  Errors 


Source 

Bias  Limits 

Precision  Index 

To 

Bt0  =  -0.14°F  Bto  =  0.17°F 

St0  =  0.55°F 

Ti 

Bf1  =  -0.14°F  Bto  =  1.01°F 

STl  =0.714°F 

Po 

Bpo  =  ±dA4%  or  0.021  psia 

SPo  =  0.18%  or  0.027  psia 

Pi 

Bpi  =  ±0.17%  or  0.173  psia 

SP1  =  0.18%  or  0.17  psia 

where 

djL 

<9T 


dr] 

dT, 


Sp.)  *  fe  Spl)  (VIII-6) 


the  rate  of  change  of  17  with  respect  to 

T0 

the  rate  of  change  of  r\  with  respect  to 
Ti 


the  rate  of  change  of  17  with  respect  to 
Po 


the  rate  of  change  of  r\  with  respect  to 

Pi 


By  substituting  into  Eqs.  (VIII-6)  and  (VIII-7),  the  precision  index  and  the  upper 
and  lower  bias  limits  are  calculated. 
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S^2  =  [(0.0036)(0.55)]2  +  [(-0.00198X0.714)]2  +  [(-0.0398)(0.027)]2  +  [(0.0061)(0.17)]2 
=  0.00000815 
=  0.002854 

( B^”)2  =  [(0.0036X-0.14)]2  +  [(- 0.00 20)  (-0.1 4)] 2  +  [(-0.0398)(0.021)]2  +  [(0.0061)(0.173)]2 

,  =  0.00000214 
=  0.00146 

(B^+)2  =  [(0.0036)(0.17)]2  +  [( -0.0020)(1.01)]2  +  [(0.0398)(0.02l)]2  +  [(0.0061)(0.173)]2 
=  0.00000626 
B  +  =  0.0025 

Bfj  is  assigned  a  negative  value  since  the  lower  limits  in  Table  XXI  are  all  negative. 

The  propagated  values  to  efficiency  are  S  =  0.0029  for  the  precision  index,  and  B"  = 
-0.0015  and  B+  =  0.0025  for  the  bias  limits.  The  error  in  specific  heat  parameters  (K)  is 
considered  negligible. 

The  uncertainty  for  the  general  model  is  the  interval  contained  between  U"  and  U+ 
where: 

IT  =  +B^“  -  t9rSv  (VIII -8) 

IJ+  =  +B^+  +  tg  rSy  (VIII-9) 

In  this  case,  tgs  =  2.0  since  all  the  degrees  of  freedom  are  greater  than  30. 

IT  =  -0.0015  -  2(0.0029)  =  -0.0073 
U+  =  +0.0025  +  2(0.0029)  =  0.0083 

For  the  nominal  values  of  Table  XXI,  the  uncertainty  interval  would  be  85% -0.0073  to 
85%  +  0.0083  or  84.27%  to  85.83%. 

8.5.3  Single  Stand,  Single  Compressor  Process 

For  a  back-to-back  development  process,  two  tests  are  performed  on  a  single  stand 
with  a  single  compressor.  No  changes  are  allowed  to  the  stand  system  or  data  recording 
equipment.  The  process  would  involve  testing  the  compressor  to  establish  a  baseline 
efficiency  value,  changing  the  compressor  configuration  and  retesting  to  determine  a  new 
efficiency  value  and  to  determine  the  delta  from  the  baseline  efficiency  value. 
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The  uncertainty  interval  for  these  tests  is  a  function  of  the  precision  error  only  of 
the  measurement  system.  The  original  table  of  elemental  errors  (Table  XXI)  is  now 
reduced  to  Table  XXIII. 


Table  XXI 19  Elemental  Errors 


Parameter 

To,°F 

Ti,°F 

P0  >  psia 

Pi,  psia 

Signal  Conditioning 

0.5 

0.5 

0.015  . 

0.1 

Precision  Index  Reference 

0.1 

0.1 

... 

... 

Root-Sum-Square 

0.51 

0.51 

0.015 

0.1 

The  root-sum-square 
errors  are  propagated  to 
efficiency  using  Taylor’s 
series  methods  described 
above  and  in  Appendix  B. 
The  measurement  of  con¬ 
cern  is  the  delta  between 
two  tests.  Therefore,  the 
uncertainty  must  be  propa¬ 
gated  to  the  delta  value: 


Ary  =  7/2  ”  *?i 


where  r\ 2  is  the  efficiency  for  the  second  run  and  r?i  is  the  efficiency  for  the  first  run.  The 
propagation  for  the  precision  term  SA77  is: 

sAj)  =  ±V\2  +  ±SV^  (VIIMO) 

The  uncertainty  resulting  from  the  values  of  Table  XXIII  is  0.0065 . 

8.6  HOW  TO  INTERPRET  UNCERTAINTY 

Uncertainty  is  a  function  of  the  measurement  process  as  discussed  in  Section  8.3.  A 
different  definition  of  the  process  would  significantly  change  the  uncertainty.  Table  XXIV 
lists  the  uncertainty  values  for  the  many  stand,  many  engine  model  and  for  the  single  stand, 
single  engine  model.  These  values  are  significantly  different,  yet  both  are  based  on  the 
elemental  errors  listed  in  Table  XXL 

Table  XXIV  Uncertainty  Values  for  Two  Processes  Uncertainty,  then,  is  a  function 

of  the  measurement  process.  It 
provides  an  estimate  of  the  largest 
error  that  may  reasonably  be  ex¬ 
pected  for  that  measurement  process 
(Fig.  VIII-1). 

Errors  larger  than  the  uncer¬ 
tainty  should  rarely  occur.  On  re¬ 
peated  runs  within  a  given  measurement  process,  the  parameter  values  should  be  within 
the  uncertainty  interval.  These  differences  might  look  like  Fig.  VIII-2.  Run-to-run 
differences  between  corresponding  values  of  Parameter  A  should  be  less  than  the 
uncertainty  for  A. 


Measurement  Process 

Uncertainty  Interval 

General  Measurement  Process 

+  3.7 

(for  Intercompany  Comparisons) 

Back-to-Back  Testing 

+  2.0 

Measurement  Process 
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Measurement 


Fig.  VIII-1  Measurement  Uncertainty 


If  the  difference  to  be 
detected  in  an  experiment  is  of 
the  same  size  or  smaller  than 
the  projected  uncertainty, 
corrective  action  should  be 
taken  to  reduce  the  uncer¬ 
tainty.  Therefore,  measure¬ 
ment  .  uncertainty  analysis 
should  always  be  done  before 
the  test  or  experiment.  The 
corrective  action  to  reduce  the 
uncertainty  may  involve  (1) 
improvements  or  additions  to  the  instrumentation,  (2)  selection  of  a  different  function  to 
obtain  the  parameter  of  interest,  and/or  (3)  repeated  testing.  Cost  and  time  will  dictate 
the  choice.  If  corrective  action  cannot  be  taken,  the  test  should  be  cancelled  as  there  is  a 
high  risk  that  the  real  differences  will  be  lost  in  the  uncertainty  interval  (undetected).  If 
the  measurement  uncertainty  analysis  is  made  after  the  test,  the  opportunity  for 
corrective  action  is  lost,  and  the  test  may  be  wasted. 

8.7  DYNAMIC  MEASUREMENT  UNCERTAINTY 


Fig.  VI 11-2  Run-to-Run  Differences 


The  same  basic  measurement  uncertainty  model  may  be  applied  to  time-varying 
data.  However,  there  are  added  complex  problems  to  solve,  and  the  services  of  a 
statistician  are  recommended.  Some  of  these  problems  are 
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1.  Time  Lags 

Different  instrumentation  will  have  different  time  lags  which  cause  serious 
problems  in  determining  time-variant  parameters.  For  example,  thrust 
specific  fuel  consumption  (TSFC)  is  based  on  fuel  flow  and  on  thrust 
determinations.  During  a  transient,  if  the  measured  value  for  one  lags 
behind  the  other,  the  ratio,  TSFC,  will  be  in  error. 

2.  Uncertainty  Varies  with  Parameter  Level 

The  uncertainty  of  the  measurements  will  probably  change  as  the  level  of 
the  parameter  changes.  This  will  be  hard  to  predict  because  some 
instruments  have  errors  which  are  constant,  independent  of  level  (error  is  a 
constant  percentage  of  full  scale,  for  example);  other  instrument  precision 
errors  and  biases  vary  as  the  level  of  the  measured  parameter  varies  (error 
as  a  percentage  of  point).  Therefore,  the  uncertainty  will  be  a  combination 
of  these  two  types  of  error  and  will  neither  remain  a  constant  percentage 
nor  change  as  a  constant  percentage  of  point. 

3.  Shifting  Flow  Profiles 

Flow  profiles  are  usually  considered  fixed  at  steady-state  points.  During 
transients,  the  profile  will  often  shift  or  change.  The  uncertainty  is 
increased  by  this  added  variation. 

4.  Autocorrelation  between  Measurements 

Time-variant  measurements  on  gas  turbines  will  usually  be  highly  related  in 
time  (autocorrelated).  The  degree  of  autocorrelation  will  have  a  significant 
effect  on  the  uncertainty  of  the  performance  parameter. 

5.  Number  of  Probes,  Location  of  Probes,  Sampling  Rate 

If  the  parameter  to  be  measured  involves  extreme  values  like  inlet 
distortion  and  burner  temperature  pattern  factor,  the  uncertainty  will  be 
highly  dependent  on  the  number  and  the  location  of  the  probes.  If  the 
parameter  involves  frequency,  the  time  rate  of  sampling  will  be  significant 
and  the  uncertainty  will  vary  as  a  function  of  both  sampling  rate  and 
frequency. 

6.  Outliers 

Outliers  in  time-variant  data  are  much  more  difficult  to  detect  and  flag 
because  of  the  variation  in  the  level  of  the  parameter.  This  could  result  in 
more  outliers  being  included  as  good  data  because  they  appear  to  be 
variations  in  the  parameter.  Therefore,  for  time-variant  data,  an  outlier 
detection  technique  should  be  used  very  carefully. 


138 


AEDC-TR-73-5 


SECTION  IX 
GLOSSARY 


1 .  Accuracy  —  The  closeness  or  agreement  between  a  measured  value  and  a  standard  or 
true  value;  uncertainty  as  used  herein,  is  the  maximum  inaccuracy  or  error  that 
may  reasonably  be  expected  (see  measurement  error). 


2.  Average  Value  -  The  arithmetic  mean  of  N  readings.  The  average  value  is  calculated 
as: 


X  =  average  value 


N 

£x« 

N 


3.  Bias  (B)  —  The  difference  between  the  average  of  all  possible  measured  values  and 
the  true  value.  The  systematic  error  or  fixed  error  which  characterizes  every 
member  of  a  set  of  measurements  (Fig.  IX-1). 


True  Value 


4.  Calibration  —  The  process  of  comparing  and  correcting  the  response  of  an 

instrument  to  agree  with  a  standard  instrument  over  the  measurement  range. 

5.  Calibration  Hierarchy  —  The  chain  of  calibrations  which  link  or  trace  a  measuring 

instrument  to  the  National  Bureau  of  Standards. 

6.  Correlation  Coefficient  —  A  measure  of  the  linear  interdependence  between  two 

variables.  It  varies  between  -1  and  +1  with  the  intermediate  value  of  zero 
indicating  the  absence  of  correlation.  The  limiting  values  indicate  perfect 
negative  (inverse)  or  positive  correlation  (Fig.  IX-2). 
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r  ■  0.0 

r  *0.6 

r 
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,  * 

;; 

*  • . 

r  «  1.0 

r  -  0.0 

r  =  -1.0 

Fig.  IX-2  Correlation  Coefficients 

7.  Coverage  -  A  property  of  confidence  intervals  with  the  connotation  of  including  or 

containing  within  the  interval  with  a  specified  relative  frequency.  Ninety -five- 
percent  confidence  intervals  provide  9 5 -percent  coverage  of  the  true  value.  That 
is,  in  repeated  sampling  when  a  95-percent  confidence  interval  is  constructed 
for  each  sample,  over  the  long  run  the  intervals  will  contain  the  true  value  95 
percent  of  the  time. 

8.  Degrees  of  Freedom  (df)  —  A  sample  of  N  values  is  said  to  have  N  degrees  of 

freedom,  and  a  statistic  calculated  from  it  is  also  said  to  have  N  degrees  of 

freedom.  But  if  k  functions  of  the  sample  values  are  held  constant,  the  number 

N  _ 

of  degrees  of  freedom  is  reduced  by  k.  For  example,  the  statistic  X  (Xi  -X)2, 

where  X  is  the  sample  mean,  is  said  to  have  N  - 1  degrees  of  freedom.  The 
justification  for  this  is  that  (a)  the  sample  mean  is  regarded  as  fixed  or  (b)  in 
normal  variation  the  N  quantities  (X| .  X)  are  distributed  independently  of  X 
and  hence  may  be  regarded  as  N  -J  independent  variates  or  N  variates 

connected  by  the  linear  relation  2(Xi  -  X)  =  0. 

9.  Elemental  Error  —  The  bias  and/or  precision  error  associated  with  a  single 

component  or  process  in  a  chain  of  components  or  processes. 

10.  Estimate  —  A  value  calculated  from  a  sample  of  data  as  a  substitute  for  an  unknown 

population  constant.  For  example,  the  sample  standard  deviation  (S)  is  the 
estimate  which  describes  the  population  standard  deviation  (a). 

1 1 .  Joint  Distribution  Function  —  A  function  describing  the  simultaneous  distribution  of 

two  variables.  The  cumulative  probability  distribution  for  2  variables. 

12.  Laboratory  Standard  —  Anjnstrument  which  is  calibrated  periodically  at  the  NBS. 

The  laboratory  standard  may  also  be  called  an  interlab  standard. 
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13.  Mathematical  Model  —  A  mathematical  description  of  a  system.  It  may  be  a 

formula,  a  computer  program,  or  a  statistical  model. 

14.  Measurement  Error  —  The  collective  term  meaning  the  difference  between  the  true 

value  and  the  measured  value.  Includes  both  bias  and  precision  error;  see 
accuracy  and  uncertainty.  Accuracy  implies  small  measurement  error  and  small 
uncertainty. 

15.  Multiple  Measurement  —  More  than  a  single  concurrent  measurement  of  the  same 

parameter. 

16.  NBS  —  National  Bureau  of  Standards.  The  reference  or  source  of  the  true  value  for 

all  measurements  in  the  United  States  of  America. 


17.  Parameter  —  An  unknown  quantity  which  may  vary  over  a  certain  set  of  values.  In 

statistics,  it  occurs  in  expressions  defining  frequency  distributions  (population 
parameters).  Examples:  the  mean  of  a  normal  distribution,  the  expected  value 
of  a  Poisson  variable. 

18.  Precision  Error  —  The  random  error  observed  in  a  set  of  repeated  measurements. 

This  error  is  the  result  of  a  large  number  of  small  effects,  each  of  which  is 
negligible  alone. 


19.  Precision  Index  —  The  precision  index  is  defined  herein  as  the  computed  standard 
deviation  of  the  measurements. 


s 


usually,  but  sometimes  S 


20.  Proving  Ring  —  Laboratory  standard  for  force  measurements. 

21.  Sample  Size  (N)  —  The  number  of  sampling  units  which  are  to  be  included  in  the 

sample. 

22.  Standard  Deviation  (g)  —  The  most  widely  used  measure  of  dispersion  of  a 

frequency  distribution.  It  is  the  precision  index  and  is  the  square  root  of  the 
variance:  S  is  an  estimate  of  o  calculated  from  a  sample  of  data. 

23.  Standard  Error  of  Estimate  —  The  measure  of  dispersion  of  the  dependent  variable 

(output)  about  the  least-squares  line  in  curve  fitting  or  regression  analysis.  It  is 
the  precision  index  of  the  output  for  any  fixed  level  of  the  independent 
variable  input.  The  formula  for  calculating  this  is 


for  a  curve  fit  for  N  data  points  in  which  K  constants  are  estimated  for  the 
curve. 
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24.  Standard  Error  of  the  Mean  —  An  estimate  of  the  scatter  in  a  set  of  sample  means 

based  on  a  given  sample  of  size  N.  The  sample  standard  deviation  (S)  is 
estimated  as  _ , 

S  =  7(X.  -  X)2/(N-1) 

Then  the  standard  error  of  the  mean  is  S/n/N?  In  the  limit,  as  N  becomes  large, 
the  estimated  standard  error  of  the  mean  converges  to  zero,  while  the  standard 
deviation  converges  to  a  fixed  non-zero  value. 

25.  Statistic  —  A  parameter  value  based  on  data.  X  and  S  are  statistics.  The  bias  limit,  a 

judgment,  is  not  a  statistic. 

26.  Statistical  Confidence  Interval  —  An  interval  estimate  of  a  population  parameter 

based  on  data.  The  confidence  level  establishes  the  coverage  of  the  interval. 
That  is,  a  95-percent  confidence  interval  would  cover  or  include  the  true  value 
of  the  parameter  95  percent  of  the  time  in  repeated  sampling. 

27.  Statistical  Quality  Control  Charts  —  A  plot  of  the  results  of  repeated  sampling  versus 

time.  The  central  tendency  and  upper  and  lower  limits  are  marked.  Points 
outside  the  limits  and  trends  and  sequences  in  the  points  indicate  non-random 
conditions. 

28.  Student’s  “t”  Distribution  (t)  —  The  ratio  of  the  difference  between  the  population 

mean  and  the  sample  mean  to  a  sample  standard  deviation  (multiplied  by  a 
constant)  in  samples  from  a  normal  population.  It  is  used  to  set  confidence 
limits  for  the  population  mean. 

29.  Taylor’s  Series  —  A  power  series  to  calculate  the  value  of  a  function  at  a  point  in 

the  neighborhood  of  some  reference  point.  The  series  expresses  the  difference 
or  differential  between  the  new  point  and  the  reference  point  in  terms  of  the 
successive  derivatives  of  the  function. 

Its  form  is  f(X)  -  Ka)  =  T*  f(r>(a)  +  Rn 

r=l  r!  n 

where  fO)(a)  denotes  the  value  of  the  rth  derivative  of  f(x)  at  the  reference 
point  X  =  a.  Commonly,  if  the  series  converges,  the  remainder  Rn  is  made 
infinitesimal  by  selecting  an  arbitary  number  of  terms. 

30.  Traceability  —  The  ability  to  trace  the  calibration  of  a  measuring  device  through  a 

chain  of  calibrations  to  the  National  Bureau  of  Standards. 

31.  Transducer  —  A  device  for  converting  mechanical  stimulation  into  an  electrical 

signal.  It  is  used  to  measure  quantities  like  pressure,  temperature,  and  force. 

32.  Transfer  Standard  —  A  laboratory  instrument  which  is  used  to  calibrate  working 

standards  and  which  is  periodically  calibrated  against  the  laboratory  standard. 
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33.  True  Value  —  The  reference  value  defined  by  the  National  Bureau  of  Standards 

which  is  assumed  to  be  the  true  value  of  any  measured  quantity. 

34.  Uncertainty  (U)  —  The  maximum  error  reasonably  expected  for  the  defined 

measurement  process:  U  =  ±(B  +  tgs S). 

35.  Variance  (a2)  —  A  measure  of  scatter  or  spread  of  a  distribution.  It  is  estimated  by 

S2  as  s(Xi  -  X)2  from  a  sampie  0f  dafa  The  variance  is  the  square  of  the 
N-  l 

standard  deviation. 

36.  Working  Standard  —  An  instrument  which  is  calibrated  in  a  laboratory  against  an 

interlab  or  transfer  standard  and  is  used  as  a  standard  in  calibrating  measuring 
instruments. 
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APPENDIX  A 

PRECISION  INDEX  FOR  UNIFORM  DISTRIBUTION  OF  ERROR 

The  precision  index  for  a  uniform  distribution  of  error  is  easily  calculated  by 
considering  the  definition  of  the  variance: 


<* 2  =  /  (x  - M  )2  p (x)  dx 


(the  general  formula  for  the  variance). 


For  a  uniform  distribution  (Fig.  A-l)  between  the  limits  of  a  and  b,  the  formula  is 
•b  /  .  .  ,v2 


dx 


where  (a  +  b)/2  is  the  mean  (ju)  of  the  uniform  distribution. 


zr 2  /  ~  /  2  ,  .  ,  %  ,  a2  +  2ab  +  b2  )  1 

a  =  #  s  -  -  (a  +  b)  x  +  — — 7— - J  — - —  dx 


(b  -  a) 


ff2  _ 


(b 


2  A  (3 

x  dx  -  -*■— 


nr* 


b  a2  +  2ab 

dx  +  — - : — 


—£ 


i— H 

1 

CM 

b 

r  *i 

.3  3 

b  -  a 

(a  +  b) 

"  2  2 
b  -  a 

a2  +  2ab  +  b2  f  1 

(b  -  a) 

3 

(b  -  a) 

2 

+  4(b  -  a)  [b  "J 

-2  _  (b  -  a)' 
12 


or  a  - 


N 


(b  -  a)' 


12 


When  a  =  -1  and  b  =  +1,  <r  = 


\J 


[l.O  -  (-1 . 0)1 _  = 


12 


>jf  *  °*577 


when  a  =  -1/2  and  b  =  +1/2,  a  = 


\J 


(i  -  (-^>)2  . 
12 


Jl/12  =  0.3 


Fig.  A-1  Uniform  Distribution 
of  Error 
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APPENDIX  B 

PROPAGATION  OF  ERRORS  BY  TAYLOR'S  SERIES 


GENERAL 

The  proofs  in  this  section  are  shown  for  two-  and  three-variable  functions.  These 
proofs  can  be  easily  extended  to  functions  with  more  variables,  although,  because  of  its 
length,  the  general  case  is  not  shown  here. 

TWO  INDEPENDENT  VARIABLES 

If  it  is  assumed  that  response  Z  is  defined  as  a  function  of  measured  variables  (x  and 
y),  the  two  restrictions  that  must  be  considered  are 

1.  Z  is  continuous  in  the  neighborhood  of  the  point  (jiix,  My)-  Both  x  and  y 
will  have  error  distributions  about  this  point  and  the  notation  (mx  and  My) 
indicates  the  mean  values  of  these  distributions. 


2.  Z  has  continuous  partial  derivatives  in  a  neighborhood  of  the  point  (jux, 

My). 


These  conditions  are  satisfied  if  the  functions  to  be  considered  are  restricted  to 
smooth  curves  in  a  neighborhood  of  the  point  with  no  discontinuities  (jumps  or  breaks  in 
the  curve).  The  Taylor’s  series  expansion  for  Z  is 


Z  =  W»y  +!|(X  -Mx>  +  f<y  ’My)  +*2 


(B-l) 


9Z  dZ 

where  —  and  -^-are  evaluated  at  the  point  (jux,  My)- 


R2  -  2 


b2Z,  •  .2  ,  d2Z.  .2 

— 2<x  -  Mx)  +  — o  (y  " 

Sx2  dy2  y 


(B-2) 


where  -  2  and  5—5. are  evaluated  at  (6i ,  8 2)  with  8 1  between  x  and  /rx ,  and  82  between 
9x2  9y2 

y  and  My . 

The  quantity  R2,  the  remainder  after  two  terms,  is  not  significant  if  either: 

1.  (x  -  Mx)  and  (y  -  M y)  are  small 

02  z  92Z 

2.  The  second  partials  — —  and  — -  are  small  or  zero.  These  partials  are  zero 

9x2  9y2 

for  linear  functions. 
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By  assuming  R2  to  be  small  or  zero,  Eq.  (B-l)  becomes 


dZ 


dz 


or 


zi"z+§7(x-^+^-My> 


Z  •  MZ  *  If  (X  ‘  ^  +  §7  (y  -  My) 


(B-3) 


(B-4) 


By  defining  Hz  as  the  average  value  of  the  distribution  of  Z,  the  difference  (Z-jUz) 
is  the  difference  of  Z  about  its  average  value.  This  difference  may  be  approximated  by 
(Eq.  (B-4)) 


dz  c)Z 

z  -mz=  -^(x  -Mx>  +s;(y  -My) 

where  the  partials  are  evaluated  at  the  point  Qix,  ny). 

The  variation  in  Z  is  defined  by 


(B-5) 


■/< 


(Z  -Mz)‘PzdZ 


where  pz  is  the  probability  density  function  of  Z.  Therefore, 
8(x  '  Mx>  +8(y  -  My)  2Pxy  dxdy 

“77  ff(x  •  Mx)|2pxy  dyd 


(B-6) 


(y  -  My) 


+ 


x 

#[8<x  -Mx>][|(y  -My)]pxy  dxdy 


“p  dxdy 
rxy 


(B-7) 


where  Pxy  is  the  joint  distribution  function  of  x  and  y.  Integrating  the  first  term  of  Eq. 
(B-7)  with  respect  to  y  and  the  second  term  of  Eq  (B-7)  with  respect  to  x  gives 

ffz=/!f  (x  -  Mx)2pxdx  /§-  (y  -  My)2pydy 

-  Mx>8(y  •  My)'Pxydxdy 


+  2 


(B-8) 


If  px  and  jJLy  are  the  means  of  the  distributions  of  x  and  y,  then  define  the  following: 

al  */(x  -  *V2pxdx  (B-9) 
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ffy  m  f 'y  -  Aiy)2pydy  (B-10) 

Pxy<*X<Iy  "/ft*  -  ^x)(y  -  My)Pxy  dxdy  (B-ll) 

where  pxy  is  the  coefficient  of  correlation  between  x  and  y.  Combining  the  definitions 
and  Eq.  (B-8)  gives 


ffz  = 


^<T2  +  4. 

5x  x  3y  y  dydx^  x°y 


If  x  and  y  are  independent  variables,  then  p  =  0  and 

,2  „  2 


THREE  INDEPENDENT  VARIABLES 


(B-12) 


(B-13) 


If  it  is  assumed  that  Z  is  a  function  of  variables  x,  y,  and  w,  two  restrictions  must 
be  considered: 

1 .  Z  is  continuous  in  a  neighborhood  of  the  point  (px ,  py ,  pw  ) 

2.  Z  has  continuous  partial  derivatives  in  a  neighborhood  of  (jux ,  py ,  pw ) 

If  these  restrictions  are  satisfied,  then  the  Taylor’s  series  expansion  for  Z  in  the  vicinity 
of  (Mx  >  My  >  Mw  )  is 


2  -  “z  +  8(x  -  Mx>  +  |<y  -  My>  +  -  Mw)  +  *2  (B-14) 


where 


H*  |f’  andHare  evaluated  at  (Mx.^.^). 


R2<  2 


(B-15) 


These  second  partials  are  evaluated  at  a  point  0i,  02 >  03  defined  so  that  0i  is  between 
px  and  x,  02  is  between  py  and  y,  and  03  is  between  pw  and  w.  The  same  restrictions 
apply  to  R.2  as  defined  for  two-variable  functions. 

By  assuming  R2  to  be  small  or  zero,  Eq.  (B-14)  becomes 

2  -  MZ  £  f!(x  ■  ^x}  +  |f(y  •  V  +  f^(w  '  MW)  (B-16) 

where  the  partials  are  evaluated  at  the  point  (px,  py,  pw). 
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The  variation  in  Z  is  defined  by 


rz  ='/z  -*z): 


pzdZ 


(B-17) 


where  pz  is  the  probability  density  function  of  Z.  Therefore, 


S(x  'Mx) 


vfff 

-Iff 

v  2JXfbx  ff(x  '  Mx)  (y  ‘  My)px-y.w  dwdxdy  +  .  .  . 


,Px>y>w  dxdydw  (B-18) 


"  ?x  5 y  >w  dwdydx  +  . . . 


(B-19) 


where  px,y,w  is  the  joint  distribution  function  of  x,  y,  and  w.  Integrating  in  the  proper 
order  produces  these  results: 

ffz=  /@)2(x  -^>2pxdx  +  •••  +  2ff^  S(x  ‘Mx)(y  'My)  Pxydxdy(B-20) 


Therefore, 


a 


2 

Z 


(£>' 


,  dz  bz 

2  cix  dyPxy°xffy 


__  M  ndZdZ„  „  „ 

+  2 5^  ^wPxwffx°w  2^y 

If  x,  y,  and  w  are  independent  variables,  then  pxy  =  pxw  =  Pyw  =  0  and 


MONTE  CARLO  SIMULATION 


(B-2 1 ) 


(B-22) 


To  determine  the  restrictions  that  must  be  placed  on  applications  of  the  method  of 
partial  derivatives,  a  Monte  Carlo  Simulator  was  designed  to  provide  simulation  checks  for 
the  computation  of  various  functions.  Comparative  results  are  listed  in  Tables  B-l  .and 

B-2. 


Table  B-l  contrasts  the  results  of  the  Monte  Carlo  simulation  of  the  functions 
tabulated,  column  (7),  with  the  estimates  using  Partial  Derivatives,  column  (6).  One 
thousand  functional  values  were  obtained  in  each  simulation.  Column  (1)  identifies  the 
function  simulated  and  column  (2)  gives  the  number  of  the  simulation  run.  Column  (3), 
Theoretical  Input,  includes  the  parameters  of  the  populations  from  which  the  random 
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Table  B-1  Results  of  Monte  Carlo  Simulation  for  Theoretical  Input  (ax2,  {jlx,  ay2,  py ) 


(1) 

(2) 

(3) 

(4) 

(5) 

(6) 

(7) 

Function 

Simulation 

Theoretical 

Method  of 

Method  of 

Input  Variance 

Observed 

Run  Number 

Input 

Partials 

Partials 

Corrected  for 

Variance 

2 

2 

Estimated 

Estimated 

Nonindependence 

(Simulator 

°x 

"x 

ay 

**y 

Variance 

Variance 

(Method  of 

Results) 

(Theoretical) 

(Actual  Input) 

Partials) 

x  +  y 

1 

1.0 

10 

4.0 

20 

5.0 

4.9477 

4.8496 

4.8567 

2 

1.0 

10 

4.0 

20 

5.0 

4.9186 

4.8435 

4.8506 

3 

1.0 

10 

4.0 

20 

5.0 

5.0786 

4.9493 

4.9564 

4 

1.0 

10 

4.0 

20 

5.0 

5.1639 

5.2444 

5.2515 

x  -  y 

1 

1.0 

10 

4.0 

20 

5.0 

4.9477 

5.0358 

5.0410 

2 

1.0 

10 

4.0 

20 

5.0 

4.9186 

4.9937 

4.9885 

3 

1.0 

10 

4.0 

20 

5.0 

5.0786 

5.2079 

5.2028 

4 

1.0 

10 

4.0 

20 

5.0 

5.1639 

5.0834 

5.0782 

00  (y) 

1 

1.0 

10 

4.0 

20 

800.0 

792.81 

773.27 

768.63 

2 

1.0 

10 

4.0 

20 

800.0 

794.33 

779.29 

797.48 

3 

1.0 

10 

4.0 

20 

800.0 

802.28 

776.41 

775.78 

4 

1.0 

10 

4.0 

20 

800.0 

867.67 

883.85 

883.38 

x/y 

1 

1.0 

10 

4.0 

20 

0.005 

0.0050 

0.0051 

0.0054 

2 

1.0 

10 

4.0 

20 

0.005 

0. 0050 

0.0051 

0.0054 

3 

1.0 

10 

4.0 

20 

0.005 

0.0050 

0.0052 

0.0055 

4 

1.0 

10 

4.0 

20 

0.005 

0.0054 

0.0053 

0.0057 

numbers  were  drawn.  Column  (4)  lists  the  method  of  partials  estimates  of  variance  for 
the  function  based  on  the  theoretical  input  (column  3).  Column  (5)  lists  the  estimates  of 
variance  for  the  function  calculated  using  the  method  of  partial  derivatives  from  the 
observed  variation  of  the  variables  x  and  y.  Column  (6)  gives  column  (5)  corrected  for 
the  observed  correlation  between  the  pairs  of  x,  y  input  values.  The  correction  factor  is: 

0  2  2  C&  dZ 

P°X° y  ax  ay 


where  p  is  the  observed  correlation  between  paired  values  of  x  and  y,  ox2  and  <jy2  are 

?\7  T\7 

the  observed  variances  of  x  and  y,  and  -r—  and  — — are  the  partial  derivatives  of  the 

ox  ay 

function  Z.  Column  (7)  lists  the  simulator  results  for  the  function  (column  1)  for  1000 
data  points. 


Table  B-2  Results  of  Monte  Carlo  Simulation  for  Theoretical  Input  pXj,  aXj 


(1) 

(2) 

(3) 

(4) 

(5) 

Function 

Z 

Number  of 
Simulations 

Bieoretical 

Input 

M  v2 

xi  xi 

Estimated  Parameters 
(Method  of  Partials) 

Mz  t 

Simulation 

Mz 

Results 

2 

(x1x2)/x;j 

2 

20 

1.0 

20 

3.00 

20.2 

20.6 

2.56 

3.24 

(x1x2)/(x;Jx4x5) 

1 

20 

1.0 

0.05 

3.12  x  10"5 

0.0505 

3.6  x  10_ 

(x^x^)  /  (x5xfix7) 

2 

20 

1.0 

20 

7.00 

20.04 

20.25 

8.41 

8.41 

l 

20 

1.0 

1.25  x  10'4 

3.52  x  10’10 

1.29  x  10"4 

4.0  x  10‘ 

("1Xl)/<X7V9> 

2 

20 

1.0 

8000 

1.44  x  106 

8150 

8300 

1.69  x  10' 
1.82  x  101 
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Columns  (1)  through  (3)  of  Table  B-2  present  the  input  to  the  Monte  Carlo 
Simulator.  The  theoretical  imput  column  (3)  shows  the  parameters  of  the  population  of 
random  numbers  that  were  used  to  produce  the  functional  values.  Column  (5) 
summarizes  the  results  of  the  simulation.  These  results  may  be  compared  with  the 
estimates  from  the  method  of  par  rials,  column  (4). 

Simulation  results  have  shown  that  the  method  of  partial  derivatives  is  most  accurate 
for  functions  involving  sums  and  differences  of  the  observed  variables.  For  these 
functions,  if  the  variables  are  mutually  independent,  the  Taylor’s  series  is  exact  for  any 
magnitude  of  error  in  the  measured  parameters.  If  the  variables  are  not  mutually 
independent,  a  correction  factor  can  be  computed  that  will  ensure  exactitude  of  the 

9Z  dZ 

method.  (The  correction  factor  (2pxy  axay  ■— )  is  the  third  term  in  Eq.  (B-12).  If  pxy 

ax.dy 

is  not  zero,  this  term  should  be  included  in  estimating  oz2  •  From  data,pxy  may  be 
estimated  with 

r 


where  n  pairs  of  observations  are  available  and  x  and  y  are  the  average  of  the  x\  and  y* 
values,  respectively.) 

Close  approximations  can  be  made  for  errors  that  exist  in  functions  involving 
products  and  quotients  of  independently  varying  observed  values  if  the  ratio  of  measured 
errors  to  their  respective  nominal  values  is  small  (less  than  0.1).  The  approximation 
improves  as  measured  errors  decrease  in  relation  to  their  nominals.  For  all  of  the 
functions  examined  involving  two  or  more  independent  variables,  the  approximation  is 
within  10  percent  of  the  true  error.  The  simulation  results  are  summarized  in  Tables  B-l 
and  B-2. 

Table  B-3  shows  the  Taylor’s  formula  for  several  functions.  In  addition,  the  Taylor’s 
formula  for  the  coefficient  of  variation  is  also  listed.  The  coefficient  of  variation  is  easily 
converted  to  a  percentage  variation  by  multiplying  by  100. 


=  =  S(x.-x)  (y.-y) 

SxSy  ^(x^x)2  2(yi-y)2 
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Func  tion 

w  =  f  (x,y) 
w  =  Ax  +  By 


Table  B-3  Error  Propagation  Formulas 

Taylor's  Formula 


•a.  +  (t 

s2  *  a2s2  +  b2s2 

w  x  y 


Coefficient  of  Variation 
Formula 


.2  22  ,  2  2„2 

2  A  x  Vv  +  B  y  V 


V  ~ 
w 


(Ax  +  By)  “ 


s2  .  s 

w  — 


2  2 
V  ~  V 
w  y 


x  +  y 


y  S 


w  V  /  ,  \2 
k  (x+y) 


f  x  S 

+  (  — *- 


(x+y) ' 


2  9  9  9  9 

vw  *  y  (vx  +  Vy)/(x+y) 


1  +  x 


S2  * 
w 


(1  +  x) 


"  (l+x)2 


w  =  xy 


1/2 


w  =  In  x 


,  a  b 
w  =  kx  y 


where : 


s«  -  <*v2  +  <*y2 


S2  «  4x2S  2 
w  x 


9  S 

s2  =  ~ 

w  4x 


S2  . 
s  w  2 
x 


2 

_  2 

V 

s  V 

w 

X 

CM 

> 

=  4V 

w 

V 

rsi 

> 

_  X 

W 

4 

V2 

y 


Sw  -  +  ^kxayb‘1Sy J  Vw2  =  (avj2  +  (bVy) 


V  = 

X  X 


V  = 

y  f 


vw  =  T  ■  w  = 
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APPENDIX  C 

ESTIMATES  OF  THE  PRECISION  INDEX  FROM  MULTIPLE  MEASUREMENTS 
INTRODUCTION 

The  derivatives,  proofs,  and  examples  of  this  section  are  presented  for  measurement 
schemes  using  two  instruments  measuring  the  same  parameter.  These  instruments  are  read 
simultaneously  and  the  difference  between  the  readings  is  analyzed  statistically  to 
estimate  instrumentation  precision  index.  The  proofs  and  derivations  can  easily  be 
extended  to  instrumentation  setups  using  more  than  two  instruments  by  considering  all 
independent  combinations  of  instrument  pairs.  Instrumentation  pairs  which  have  a  fixed 
constant  locational  bias  between  them  can  also  be  analyzed  to  provide  estimates  of 
precision  index. 

DISCUSSION 


In  any  measurement  system,  if  the  parameter  which  is  being  measured  is  a  constant, 
the  precision  error  of  the  measurement  instruments  is  easy  to  identify.  The  variance  (S2) 
of  the  measurements  (Xi)  about  the  average  measurement  (X)  provides  an  unbiased 
estimate  of  the  variance  of  the  instrument: 


2(X.  -  X)2 

N  -  1 


(for  N  measurements) 


(C-l) 


In  the  usual  case,  the  measured  parameter  is  not  constant.  Then  the  variation  of  the 
readings  is  increased  by  the  variation  of  the  parameter,  and  any  directly  computed 
statistic  is  subjected  to  large  errors.  However,  multiple  instruments  can  be  analyzed  to 
estimate  the  precision  error  in  the  measurement  system. 

For  example,  if  two  instruments  are  measuring  a  parameter  X,  then  an  appropriate 
mathematical  model  for  each  reading  would  be  Xj  +  ey  where  X*  is  a  typical  parameter 
value  and  eij  is  the  corresponding  precision  error  for  the  jth  instrument.  (For  simplicity, 
bias  error  is  ignored  as  it  has  no  effect  on  these  methods.)  A  series  of  such  readings  is 
illustrated  in  Table  C-l. 


Table  C-1  Multiple  Measurements  of  a  Parameter 

True 

Va lue  Instrument  One  Instrument  Two 


X, 

+ 

X, 

+  ( 

1 

•1 

11 

1 

c12 

xn 

X0 

x0 

-f-  ( 

2 

2 

21 

2 

c22 

X, 

X, 

+ 

x„ 

+  € 

3 

3 

31 

3 

C32 

• 

9 

• 

• 

9 

• 

0 

9 

• 

X 

n 

X 

n 

+ 

H 

a 

X 

n 

CM 

£ 

f 
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This  list  is  provided  by  making  simultaneous  readings  of  instruments  one  and  two. 
By  subtracting  the  reading  of  instrument  one  from  instrument  two,  a  column  of 
differences  can  be  produced  which  is  independent  of  the  variation  of  the  parameter 
(Table  C-2). 


Table  C-2  Multiple  Measurement  Difference 


Instrument  One  Instrument  Two 


xi  +  *n 


X1  +  *12 


Average 

X  ,  •»>  *  V 

XI  2 


Difference 


*n  -  ‘12  ■ 


X2  +  *21 


X2  +  *22 


X  +  ^  +  *3 
X2  +  2 


*21  '  *22  A2 


X3  +  *31 


X3  +  *32 


*31  +  *32 
X3  +  2 


*31  ‘  *32  A3 


X  +  t  . 
n  nl 


X  +  6 
n  n2 


X  + 
n 


^nl  *n2 


€nl  ‘  *n2  "  *n 


The  variation  of  these  differences  (Sa)  provides  an  unbiased  estimate  of  the  precision 
error  of  the  average  reading  of  the  two  instruments.  That  is,  Sa  can  be  used  to  estimate 
Sreading  based  on  Eq.  (C-l). 


(C-2) 


where  A  is  the  average  difference  between  the  meters  and  n  is  the  number  of  differences. 
It  can  be  proved  that  the  estimate  of  the  precision  index  of  the  average  reading  is  then 


Sa/2 


4(n  -  1) 


(C-3) 
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This  is  based  on  the  assumption  that  the  two  meters  have  independent  precision  errors. 
The  formulation  is  derived  from  Taylor’s  Series  expansion  in  Appendix  B,  for  precision 
errors  in  calculated  values.  For  example,  if  a  single  pair  of  multiple  readings  is  made,  the 
error  is  (eu  +  6^)12  if  the  average  of  the  two  readings  is  recorded.  The  precision  index 
of  this  average  value  may  be  estimated  using  the  Taylor’s  series  expansion: 


(C-5) 


and 


In  the  same  manner,  the  precision  index  of  eu  -  e\2  (Eq.  (C-2))  can  be  shown  to  be: 


(C-6) 


or 


+  M)‘ 


(C-8) 


By  combining  Eqs.  (C-2),  (C-6),  and  (C-8),  the  precision  error  estimate  for  the  average 
reading  of  Table  C-2  is 


(C-9) 
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The  method  described  in  the  preceding  discussion  does  not  include  long-term  drifts, 
calibration  errors,  and  other  precision  errors  that  do  not  vary  from  data  point-to-data 
point,  from  stand-to-stand,  and  from  calibration-to-calibration.  A  new  mathematical 
model  must  be  developed  based  on  an  engineering  analysis  including  these  effects. 

To  illustrate  the  method,  the  mathematical  model  derived  for  a  turbojet  engine  will 
be  used.  Again,  X  is  the  parameter  being  measured;  then 

Reading^  =  X.  .  n  4-  a.  +  0.  .  +  €.  .  n 
£  1-  T-J  IJj l 

is  the  mathematical  model  of  reading  2  of  a  typical  instrument  during  run  j  and  since 
calibration  i.  The  model  assumes  a  within  test  (short-term)  component  of  precision  error 
(eijl)>  a  test-to-test  (long-term)  component  or  precision  error  (j3jj)  which  is  constant 
within  a  test  and  a  calibration-to-calibration  error  (ai)  which  is  constant  within  each 
calibration  and  within  test  within  each  calibration. 


Table  C-3  illustrates  a  series  of  readings  of  a  multiple  instrumented  parameter, 
assuming  this  model  and  the  differences  of  the  simultaneous  readings  of  instruments  one 
and  two.  Notice  that,  within  each  run,  the  run-to-run  and  calibration-to-calibration 
components  are  constant.  Between  the  averages  of  each  run,  the  within  run  components 
are  reduced  and  the  calibration-to-calibration  components  are  constant  allowing  estimates 
of  run-to-run  components.  Finally,  the  between  two  calibrations,  the  within  run,  and 
run-to-run  components  are  reduced  allowing  an  estimate  of  calibration-to-calibration 
error.  The  method  of  analysis  is  that  of  a  one-way  nested  analysis  of  variance. 

The  analysis  can  be  completed  using  the  formulas  of  Table  C-4.  The  last  column  of 
this  table  provides  the  estimates  of  the  precision  index  for  calibration-to-calibration  error, 
run- to-run  error,  and  within  run  error.  The  third  column,  mean  square,  is  calculated  by 
dividing  the  value  of  the  sum  of  squares  (column  1)  by  the  proper  degrees  of  freedom 
(column  2). 


The  estimate  of  the  total  precision  index,  for  a  multiple  instrumented  parameter 
(average  of  two  measurements)  on  a  particular  run  and  calibration,  would  be  the 
root-sum-square  of  the  three  estimates:  within  test  precision  index  (Swt),  test-to-test 
precision  index  (Stt )?  and  calibration-to-calibration  precision  index  (Scc);  that  is, 


S 


2 


T 


wt 


The  degrees  of  freedom  for  this  estimate  can  be  calculated  from  the  degrees  of 
freedom  for  each  estimate  using  the  Welch-Satterthwaite  formula. 
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Kth  Run  2nd  Run  1st  Run  Kth  Run  2nd  Run  1st  Run 


Table  C-3  Differences  in  Readings  of  Multiple  Instruments 
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Table  C-4  Analysis  of  Precision  Error  from  Multiple  Instrument  Differences 
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APPENDIX  D 
OUTLIER  DETECTION 

GENERAL 

All  measurement  systems  may  produce  wild  data  points.  These  points  may  be  caused 
by  temporary  or  intermittent  malfunctions  of  the  measurement  system,  or  they  may 
represent  actual  variations  in  the  measurement.  Errors  of  this  type  cannot  be  estimated  as 
part  of  the  uncertainty  of  the  measurement.  The  points  are  out-of-control  points  for  the 
system  and  are  meaningless 
as  steady-state  test  data. 

They  should  be  discarded. 

Figure  D-l  shows  two  spuri¬ 
ous  data  points  (sometimes 

called  outliers).  Parameter 

Level 

All  data  should  be 
inspected  for  wild  data 
points  as  a  continuing  quality 
control  check  on  the  meas-  Fig.  D-1  Outliers  Outside  the  Range  of 

urement  process.  Identifica-  Acceptable  Data 

tion  criteria  should  be  based 

on  engineering  analysis  of  instrumentation,  thermodynamics,  flow  profiles,  and  past 
history  with  similar  data.  To  ease  the  burden  of  scanning  large  masses  of  data,  a 
computerized  routine  is  available  to  scan  steady-state  data  and  flag  suspected  outliers. 
The  flagged  points  should  then  be  subjected  to  a  comprehensive  engineering  analysis. 

This  routine  is  intended  to  be  used  in  scanning  small  samples  of  data  from  a  large 
number  of  parameters  at  many  time  slices.  The  work  of  paging  through  volumes  of  data 
can  be  reduced  to  a  manageable  job  with  this  approach.  The  computer  will  scan  the  data 
and  flag  suspect  points.  The  engineer,  relieved  of  the  burden  of  scanning  the  data,  can 
closely  examine  each  suspected  wild  point. 

ARNOLD  ENGINEERING  DEVELOPMENT  CENTER  OUTLIER  METHOD 

Several  general  purpose  outlier  techniques  were  reviewed  and  discussed  in  the  ICRPG 
Handbook  CPIA  180.  The  U.S.  Air  Force  Arnold  Engineering  Development  Center 
(AEDC)  has  developed  a  new  technique  to  flag  outliers  in  small  or  moderately  sized 
samples  of  data.  This  technique  was  compared  with  the  Thompson’s  Tau  Technique  used 
in  ICRPG  CPIA  180.  The  AEDC  method  as  compared  with  the  Thompson’s  Tau  method 
detects  a  larger  proportion  of  the  outliers  in  the  data,  and  when  no  outliers  are  present, 
it  flags  fewer  good  points.  The  AEDC  method  is  useful  for  computer  routines  since  it  is 
fast  and  requires  little  core  storage.  The  method  discriminates  between  good  data  and 
outliers  by  examining  how  far  each  point  lies  from  the  average  value. 

The  first  step  is  to  calculate  an  average  value  (X)  and  a  standard  deviation  (s)  from 
the  data. 
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X 


N  X. 

s  — 

i=l  N 


s  =  ± 


2 


Then,  from  the  sample  size  (N),  a  test  value  (C)  is  calculated  from 

n  -1.6819236  +  1.6386898N  -  0.00721312N2 

^  ~  2 
1.0  +  0.5928677 2N  -  0.00355709N 

when  N  <  65.  When  N  >  65,  C  =  3  is  used.  Each  data  point  is  tested  to  determine  if  it 
falls  in  the  interval,  average  value  plus  or  minus  the  standard  deviation  times  C,  i.e., 

X  ±  Cs 


If  a  data  point  falls  outside  the  interval,  it  is  flagged  as  an  outlier. 

The  formula  for  calculating  C  was  determined  at  AEDC  and  was  based  on 
engineering  judgment  to  determine  the  expected  intervals  for  good  data  in  the  range  of 
10  to  30  samples.  Then  the  curve  (C|  was  fit  to  the  data  (Fig.  D-2).  For  sample  sizes  of 
65  or  greater,  C  =  3  should  be  used. 

AN  EXAMPLE  OF  THE  AEDC  METHOD 

The  AEDC  Fortran  Subroutine  is  used  to  test  the  data  in  Table  D-l  for  outliers. 


Fig.  D-2  Parameter  C  versus  Sample  Size 


Table  D-1 
Pressure  Data 
for  Outlier 
Test 


Point 

No. 

Pressure, 

psia 

1 

12.96 

2 

13.15 

3 

13.01 

4 

13.11 

5 

13.30 

6 

13.68 

7 

13.26 

8 

13.10 

9 

12.84 

10 

13.19 

11 

13.25 

12 

13.39 

13 

13.11 

14 

13.03 

15 

12.96 
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The  first  step  is  to  calculate  the  mean  (X)  and  standard  deviation  (s)  for  the  data: 


15 

X  x. 

X  =  — =  13.156 


S 


±0.2057 


The  test  value  (C)  is  calculated  based  on  the  sample  size  (N). 

r  -1.6819236  +  1.6386898N  -  0.00721312N2 

^  *  -  —  —  Zi .  o 

1.0  +  0.59286772N  -  0.00355709N2 

Each_data  point  is  checked  to  determine  if  it  falls  in  the 
interval  X  ±  Cs,  which  in  this  case  is  12.6747_to  13.6373.  A 
convenient  method  for  doing  this  is  to  subtract  X  from  each  data 
point  to  determine  the  deviation  (Xi  -  X).  Then,  this  is  checked 
against  Cs  =  2.3398  times  0.2057  =  0.4813. 

Table  D-2  lists  the  deviations  (Xi  -  X)  for  the  data.  In  this 
case,  point  number  six  has  a  deviation  which  is  greater  than 
0.4813.  It  is  flagged  as  an  outlier  and  printed  out  by  the 
subroutine. 


Table  D-2 


Point 

No. 

Deviation 

(Xi-X) 

1 

-0.196 

2 

-0.006 

3 

-0.146 

4 

-0.046 

5 

0.144 

6 

0.524 

7 

0.104 

8 

-0.056 

9 

-0.316 

10 

0.034 

11 

0.094 

12 

0.234 

13 

-0.046 

14 

-0.126 

15 

-0.196 

THE  FORTRAN  SUBROUTINE 


The  following  is  a  listing  of  a  subroutine  to  implement  the  AEDC  outlier  rejection 
method  in  a  computer  program.  The  subroutine  is  written  in  American  National  Standard 
Fortran  IV.  The  subroutine  was  compiled  and  run  on  an  IBM  360,  model  75,  with  a 
G-level  compiler  operating  under  IBM  release  20.1. 


c 
c 
c 
c 
•  C 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 

c 


SUBROUTINE  CAVG  <  XBAR •  SIG  •  X  •  N  •  IELIM  ) 

AEDC  OUTLIER  REJECTION  SUBROUTINE 

XBAR  MEAN  CALCULATED  AFTER  OUTLIERS  HAVE  BEEN  REMOVED  FROM 

DATA 

X  INPUT  ARRAY  OF  SAMPLE  DATA 

SIG  STANDARD  DEVIATION  CALCULATED  AFTER  OUTLIERS  HAVE  BEEN 

REMOVED  FROM  THE  DATA 

N  NUMBER  OF  DATA  POINTS  IN  DATA  SAMPLE#  X 

IELIM  NUMBER  OF  OUTLIERS  REJECTED  IN  SAMPLE  OF  DATA 
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IF  A  SAMPLE  DATA  POINT  IS  FOUND  TO  BE  AN  OUTLIER*  ITS  VALUE  IS 
SET  TO  0*0  . 

SAMPLE  DATA  POINTS  EQUAL  TO  ZERO  INPUT  TO  THE  SUBROUTINE  ARE 
DISCARDED  FROM  THE  SAMPLE. 


DIMENSION  XU)  *  DEL  (  100) 

IND  *  0 
IELIM  ■  0 
WRITE<6*102) 

102  FORMAT ( / •  BEFORE  REMOVING  OUTLIERS* /) 

1  SUM  s  0. 

NN  a  o 
DO  3  I  =  1  *N 

IF  (  X(I )  . EQ.  0.  )  GO  TO  3 

NN  «  NN  M 

SUM  a  SUM  ♦  X( I  ) 

3  CONTINUE 

IF  (  NN  *LT •  2  )  RETURN 
XBAR  =  SUM  /  NN 
SUM2  «  0. 

DO  4  I  »  1  •  N 

IF  (  X ( I )  . EQ.  0.  )  GO  TO  4 
DEL (  I  )  ■  ABS (  X(I)  -  XBAR  ) 

SUM2  ■  SUM2  ♦  DEL ( I )**2 
U  CONTINUE 
C  *  3. 

SIG  ■  SORT  (  SUM2  /  (  NN  -  1  ) ) 

WRITE (6*101 ) XBAR.S IG*NN 

.101  FORMAT*/'  MEAN* *  •  E20. 7 • 5X  •  ' STD.  DEV. « ♦ *E20. 7  * 5X* * N« *  *  I  5/ ) 

IF  (  IND  • EQ •  1  )  RETURN 

IF  (  NN  •  LE .  65  )  C  *  ( -1 .681923600  ♦  1.6386,89000  *  NN 

1  -.0072131 2D0  *  NN  *  NN  )  /  (  1.D0 

2  +.59296772DO  *  NN  -  .00355709D0  *  NN  *  NN  ) 
CS  a  c  *  SIG 

<  =  NN 

DO  5  I  »  1*N 

IF  (  X ( I )  • EQ.  0.  .OR.  DEL ( I )  • LE •  CS  )  GO  TO  5 

NN  =  NN  -  1 

WRITE (6* 100)  I  ♦  X ( I  ) 

100  FORMAT ( /5X • 'POINT  NO. ' • 15* '  VALUE® ' • E20 • 7 * '  HAS  BEEN  REJECTED* / ) 

X  (  I )  »  0. 

5  CONTINUE 

IELIM  ®  K  -  NN 
IND  ®  1 

IF  (  K  .EQ.  NN)  RETURN 
WRITE(6*103) 

103  FORMAT ( / '  AFTER  REMOVING  OUTLIERS'/ ) 

GO  TO  1 

999  CONTINUE 
END 
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APPENDIX  E 
TABLES 

This  section  of  the  Appendix  presents  the  tables  of  the  Student’s  “t”  distribution, 
the  F  table  for  comparison  of  precision  indices,  and  the  Thompson’s  Tau  table  for  the 
outlier  test. 


STUDENTS  "t"  TABLE 


The  table  of  Student’s  “t”  distribution  (Table  E-l)  presents  the  two-tailed 
95-percent  “t”  values  for  the  degrees  of  freedom  from  one  to  30.  Above  30,  round  the 
value  to  2.0. 


Table  E-1  Two-Tailed  Student's  "t"  Table 


Degrees  of 

Freedom 

"t" 

1 

12.706 

2 

4.303 

3 

3.182 

4 

2.776 

5 

2.571 

6 

2.447 

7 

2.365 

8 

2.306 

9 

2.262 

10 

2.228 

11 

2.201 

12 

2.179 

13 

2.160 

14 

2.145 

15 

2.131 

16 

2.120 

Degrees  of 


Freedom 

"t" 

17 

2.110 

18 

2.101 

19 

2.093 

20 

2.086 

21 

2.080 

22 

2.074 

23 

2.069 

24 

2.064 

25 

2.060 

26 

2.056 

27 

2.052 

28 

2.048 

29 

2.045 

30 

2.042 

31  or  more 

use  2.0 

The  table  is  used  to  provide  an  interval  estimate  of  the  true  value  about  an  observed 
value.  The  interval  is  the  measurement  plus  and  minus  the  standard  deviation  of  the 
observed  value  times  the  “t”  value  (for  the  degrees  of  freedom  of  that  standard 
deviation): 

interval  =  measurement  ±  t95S 
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The  95-percent  Student’s  “t”  value  for  a  standard  deviation  of  50  lb  with  17  deg  of 
freedom  is  2.110.  The  interval  is 

measurement  ±  2.11  x  50  =  measurement  +  105.50  lb 


F  TABLE 

The  table  of  95-percent  F  values  (Table  E-2)  is  presented  for  tests  for  a  significant 
increase  in  precision  index.  The  test  is  performed  by  dividing  the  square  of  the  new 
precision  index  by  the  square  of  the  old  index  : 


s  2 

p  new 

r  calculated  “  7  2~ 

old 


This  calculated  value  is  compared  with  the  F  table  value  for  fi  and  f2  degrees  of 
freedom;  f i  is  the  degrees  of  freedom  for  Snew2>  and  f2  is  the  degrees  of  freedom  for 
Sold2* 


For  example,  suppose  that  the  pooled  precision  index  for  a  force  measuring  device  is 
0.05  percent  based  on  four  sets  of  5  tests  each  (total  of  16  degrees  of  freedom).  A  new 
estimate  of  precision  index  is  0.10  percent  based  on  a  sample  size  of  5.  The  F  calculated 
value  is: 


F  _  Snew  _  (0*1)2  _  0*0100  4  00 

calculated  ~  s^2  ~  ^^2  '  0.002'  '  ' 

fi  =  4  and  f2  =  16,  the  table  value  of  F  is  3.01.  Because  4.00  is  greater  than  3.01,  this 
indicates  the  new  index  is  significantly  larger  than  the  old  index. 

THOMPSON'S  TAU  TABLE 

Thompson’s  Tau  Table  (Table  E-3)  is  presented  to  aid  in  detecting  outliers  or  bad 
data  in  a  sample.  The  table  is  given  for  several  levels  of  significance  (p).  If  p  =  0.05  level 
is  used,  this  sets  the  probability  of  a  good  point  at  5  percent.  The  procedure  for  the  test 
is  this: 


1.  From  the  data  (Xj;  i  =  l,n)  containing  the  suspected  outlier X',  two 
statistics  are  calculated: 


X  = 


N 

i=l 


X. 


N 
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Table  E-2  5-percent  Fractiles  of  the  F  Distribution 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 
12 

13 

14 

15 

16 

17 

18 

19 

20 

21 
22 

23 

24 

25 

26 
28 
30 
34 
38 

40 
44 
48 
50 
55 
60 
65 
80 
100 
150 

200 

1000 


Degrees  of  Freedom  for  the  Numerator  (f^) 


F(fx, 


new 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

12 

15 

17 

161 

200 

216 

225 

230 

234 

237 

239 

241 

242 

244 

246 

247 

18.5 

19.0 

19.2 

19.2 

19.3 

19.3 

19.4 

19.4 

19.4 

19.4 

19.4 

19.4 

19.4 

10.1 

9.55 

9.28 

9.12 

9.01 

8.94 

8.89 

8.85 

8.81 

8.79 

8.74 

8.70 

8.68 

7.71 

6.94 

6.59 

6.39 

6.26 

6.16 

6.09 

6.04 

6.00 

5.96 

5.91 

5.86 

5.83 

6.61 

5.79 

5.41 

5.19 

5.05 

4.95 

4.88 

4.82 

4.77 

4.74 

4.68 

4.62 

4.59 

5.99 

5.14 

4.76 

4.53 

4.39 

4.28 

4.21 

4.15 

4.10 

4.06 

4.00 

3.94 

3.91 

5.59 

4.74 

4.35 

4.12 

3.97 

3.87 

3.79 

3.73 

3.68 

3.64 

3.57 

3.51 

3.48 

5.32 

4.46 

4.07 

3.84 

3.69 

3.58 

3.50 

3.44 

3.39 

3.35 

3.28 

3.22 

3.19 

5.12 

4.26 

3.86 

3.63 

3.48 

3.37 

3.29 

3.23 

3.18 

3.14 

3.07 

3.01 

2.97 

4.96 

4.10 

3.71 

3.48 

3.33 

3.22 

3.14 

3.07 

3.02 

2.98 

2.91 

2.85 

2.81 

4.84 

3.98 

3.59 

3.36 

3.20 

3.09 

3.01 

2.95 

2.90 

2.85 

2.79 

2.72 

2.69 

4.75 

3.89 

3.49 

3.26 

3.11 

3.00 

2.91 

2.85 

2.80 

2.75 

2.69 

2.62 

2.58 

4.67 

3.81 

3.41 

3.18 

3.03 

2.92 

2.83 

2.77 

2.71 

2.67 

2.60 

2.53 

2.50 

4.60 

3.74 

3.34 

3.11 

2.96 

2.85 

2.76 

2.70 

2.65 

2.60 

2.53 

2.46 

2.43 

4.54 

3.68 

3.29 

3.06 

2.90 

2.79 

2.71 

2.64 

2.59 

2.54 

2.48 

2.40 

2.37 

4.49 

3.63 

3.24 

3.01 

2.85 

2.74 

2.66 

2.59 

2.54 

2.49 

2.42 

2.35 

2.32 

4.45 

3.59 

3.20 

2.96 

2.81 

2.70 

2.61 

2.55 

2.49 

2.45 

2.38 

2.31 

2.27 

4.41 

3.55 

3.16 

2.93 

2.77 

2.66 

2.58 

2.51 

2.46 

2.41 

2.34 

2.27 

2.23 

4.38 

3.52 

3.13 

2.90 

2.74 

2.63 

2.54 

2.48 

2.42 

2.38 

2.31 

2.23 

2.20 

4.35 

3.49 

3.10 

2.87 

2.71 

2.60 

2.51 

2.45 

2.39 

2.35 

2.28 

2.20 

2.17 

4.32 

3.47 

3.07 

2.84 

2.68 

2.57 

2.49 

2.42 

2.37 

2.32 

2.25 

2.18 

2.14 

4.30 

3.44 

3.05 

2.82 

2.66 

2.55 

2.46 

2.40 

2.34 

2.30 

2.23 

2.15 

2.11 

4.28 

3.42 

3.03 

2.80. 

2.64 

2.53 

2.44 

2.37 

2.32 

2.27 

2.20 

2.13 

2.09 

4.26 

3.40 

3.01 

2.78 

2.62 

2.51 

2.42 

2.36 

2.30 

2.25 

2.18 

2.11 

2.07 

4.24 

3.39 

2.99 

2.76 

2.60 

2.49 

2.40 

2.34 

2.28 

2.24 

2.16 

2.09 

2.05 

4.23 

3.37 

2.98 

2.74 

2.59 

2.47 

2.39 

2.32 

2.27 

2.22 

2.15 

2.07 

2.03 

4.20 

3.34 

2.95 

2.71 

2.56 

2.45 

2.36 

2.29 

2.24 

2.19 

2.12 

2.04 

2.00 

4.17 

3.32 

2.92 

2.69 

2.53 

2.42 

2.33 

2.27 

2.21 

2.16 

2.09 

2.01 

1.98 

4.13 

3.28 

2.88 

2.65 

2.49 

2.38 

2.29 

2.23 

2.17 

2.12 

2.05 

1.97 

1.93 

4.10 

3.24 

2.85 

2.62 

2.46 

2.35 

2.26 

2.19 

2.14 

2.09 

2.02 

1.94 

1.90 

4.08 

3.23 

2.84 

2.61 

2.45 

2.34 

2.25 

2.18 

2.12 

2.08 

2.00 

1.92 

1.89 

4.06 

3.21 

2.82 

2.58 

2.43 

2.31 

2.23 

2.16 

2.10 

2.05 

1.98 

1.90 

1.86 

4.04 

3.19 

2.80 

2.57 

2.41 

2.29 

2.21 

2.14 

2.08 

2.03 

1.96 

1.88 

1.84 

4.03 

3.18 

2.79 

2.56 

2.40 

2.29 

2.20 

2.13 

2.07 

2,03 

1.95 

1.87 

1.83 

4.02 

3.16 

2.77 

2.54 

2.38 

2.27 

2.18 

2.11 

2.06 

2.01 

1.93 

1.85 

1.81 

4.00 

3.15 

2.76 

2.53 

2.37 

2.25 

2.17 

2.10 

2.04 

1.99 

1.92 

1.84 

1.80 

3.99 

3.14 

2.75 

2.51 

2.36 

2.24 

2.15 

2.08 

2.03 

1.98 

1.90 

1.82 

1.78 

3.96 

3.11 

2.72 

2.49 

2.33 

2.21 

2.13 

2.06 

2.00 

1.95 

1.88 

1.79 

1.75 

3.94 

3.09 

2.70 

2.46 

2.31 

2.19 

2.10 

2.03 

1.97 

1.93 

1.85 

1.77 

1.73 

3.90 

3.06 

2.66 

2.43 

2.27 

2.16 

2.07 

2.00 

1.94 

1.89 

1.82 

1.73 

1.69 

3.89 

3.04 

2.65 

2.42 

2.26 

2.14 

2.06 

1.98 

1.93 

1.88 

1.80 

1.72 

1.67 

3.85 

3.00 

2.61 

2.38 

2.22 

2.11 

2.02 

1.95 

1.89 

1.84 

1.76 

1.68 

1.63 

3.84 

3.00 

2.60 

2.37 

2.21 

2.10 

2.01 

1.94 

1.88 

1.83 

1.75 

1.67 

1.62 
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19 

20 

22 

24 

26 

30 

35 

40 

50 

100 

500 

CO 

2. 

48 

248 

249 

249 

249 

250 

251 

251 

252 

253 

254 

254 

1 

19.4 

19.4 

19.5 

19.5 

19.5 

19.5 

19.5 

19.5 

19.5 

19.5 

19.5 

19.5 

2 

8 

.67 

8.66 

8 

.65 

8.64 

8.63 

8.62 

8.60 

8.59 

8.58 

8.55 

8.53 

8.53 

3 

5 

.81 

5.80 

5 

.79 

5.77 

5.76 

5.75 

5.73 

5.72 

5.70 

5.66 

5.64 

5.63 

4 

4 

.57 

4.56 

4 

.54 

4.53 

4.52 

4.50 

4.48 

4.46 

4.44 

4.41 

4.37 

4.37 

5 

3 

.88 

3.87 

3 

.86 

3.84 

3.83 

3.81 

3.79 

3.77 

3.75 

3.71 

3.68 

3.67 

6 

3 

.46 

3.44 

3 

.43 

3.41 

3.40 

3.33 

3.36 

3.34 

3.32 

3.27 

3.24 

3.23 

7 

3 

.16 

3.15 

3 

.13 

3.12 

3.10 

3.08 

3.06 

3.04 

3.02 

2.97 

2.94 

2.93 

8 

2 

.95 

2.94 

2 

.92 

2.90 

2.89 

2.86 

2.84 

2.83 

2.80 

2.76 

2.72 

2.71 

9 

2 

.78 

2.77 

2 

.75 

2.74 

2.72 

2.70 

2.68 

2.66 

2.64 

2.59 

2.55 

2.54 

10 

2 

.66 

2.65 

2 

.63 

2.61 

2.59 

2.57 

2.55 

2.53 

2.51 

2.46 

2.42 

2.40 

11 

2 

.56 

2.54 

2, 

.52 

2.51 

2.49 

2.47 

2.44 

2.43 

2.40 

2.35 

2.31 

2.30 

12 

2 

.47 

2.46 

2, 

.44 

2.42 

2.41 

2.38 

2.36 

2.34 

2.31 

2.26 

2.22 

2.21 

13 

2 

.40 

2.39 

2, 

.37 

2.35 

2.33 

2.31 

2.28 

2.27 

2.24 

2.19 

2.14 

2.13 

14 

2 

.34 

2.33 

2, 

.31 

2.29 

2.27 

2.25 

2.22 

2.20 

2.18 

2.12 

2.08 

2.07 

15 

2 

.29 

2.28 

2, 

.25 

2.24 

2.22 

2.19 

2.17 

2.15 

2.12 

2.07 

2.02 

2.01 

16 

2 

.24 

2.23 

2, 

.21 

2.19 

2.17 

2.15 

2.12 

2.10 

2.08 

2.02 

1.97 

1.96 

17 

2 , 

.20 

2.19 

2. 

,17 

2.15 

2.13 

2.11 

2.08 

2.06 

2.04 

1.98 

1.93 

1.92 

18 

2, 

.17 

2.16 

2. 

,13 

2.11 

2.10 

2.07 

2.05 

2.03 

2.00 

1.94 

1.89 

1.88 

19 

2, 

.14 

2.12 

2. 

,10 

2.08 

2.07 

2.04 

2.01 

1.99 

1.97 

1.91 

1.86 

1.84 

20 

2, 

.11 

2.10 

2. 

,07 

2.05 

2.04 

2.01 

1.98 

1.96 

1.94 

1.88 

1.82 

1.81 

21 

2, 

.08 

2.07 

2. 

,05 

2.03 

2.01 

1.98 

1.96 

1.94 

1.91 

1.85 

1.80 

1.78 

22 

2, 

.06 

2.05 

2. 

,02 

2.00 

1.99 

1.96 

1.93 

1.91 

1.88 

1.82 

1.77 

1.76 

23 

2, 

.04 

2.03 

2. 

,00 

1.98 

1.97 

1.94 

1.91 

1.89 

1.86 

1.80 

1.75 

1.73 

24 

2, 

.02 

2.01 

1. 

,98 

1.96 

1.95 

1.92 

1.89 

1.87 

1.84 

1.78 

1.73 

1.71 

25 

2, 

.00 

1.99 

1. 

,97 

1.95 

1.93 

1.90 

1.87 

1.85 

1.82 

1.76 

1.71 

1.69 

26 

1. 

.97 

1.96 

1. 

,93 

1.91 

1.90 

1.87 

1.84 

1.82 

1.79 

1.73 

1.67 

1.65 

28 

1. 

,95 

1.93 

1. 

,91 

1.89 

1.87 

1.84 

1.81 

1.79 

1.76 

1.70 

1.64 

1.62 

30 

1, 

,90 

1.89 

1. 

,86 

1.84 

1.82 

1.80 

1.77 

1.75 

1.71 

1.65 

1.59 

1.57 

34 

1, 

,87 

1.85 

1. 

83 

1.81 

1.79 

1.76 

1.73 

1.71 

1.68 

1.61 

1.54 

1.53 

38 

1. 

,85 

1.84 

1. 

81 

1.79 

1.77 

1.74 

1.72 

1.69 

1.66 

1.59 

1.53 

1.51 

40 

1. 

,  83 

1.81 

1. 

79 

1.77 

1.75 

1.72 

1.69 

1.67 

1.63 

1.56 

1.49 

1.48 

44 

1. 

,81 

1.79 

1. 

77 

1.75 

1.73 

1.70 

1.67 

1.64 

1.61 

1.54 

1.47 

1.45 

48 

1. 

,80 

1.78 

1. 

76 

1.74 

1.72 

1.69 

1.66 

1.63 

1.60 

1.52 

1.46 

1.44 

50 

1. 

,78 

1.76 

1. 

74 

1.72 

1.70 

1.67 

1.64 

1.61 

1.58 

1.50 

1.43 

1.41 

55 

1. 

,76 

1.75 

1. 

72 

1.70 

1.68 

1.65 

1.62 

1.59 

1.56 

1.48 

1.41 

1.39 

60 

1. 

,75 

1.73 

1. 

71 

1.69 

1.67 

1.63 

1.60 

1.58 

1.54 

1.46 

1.39 

1.37 

65 

1. 

,72 

1.70 

1. 

68 

1.65 

1.63 

1.60 

1.57 

1.54 

1.51 

1.43 

1.35 

1.32 

80 

1. 

,69 

1.68 

1. 

65 

1.63 

1.61 

1.57 

1.54 

1.52 

1.48 

1.39 

1.31 

1.28 

100 

1. 

,66 

1.64 

1. 

61 

1.59 

1.57 

1.53 

1.50 

1.48 

1.44 

1.34 

1.25 

1.22 

150 

1. 

,  64 

1.62 

1. 

60 

1.57 

1.55 

1.52 

1.48 

1.46 

1.41 

1.32 

1.22 

1.19 

200 

1. 

,60 

1.58 

1. 

55 

1.53 

1.51 

1.47 

1.44 

1.41 

1.36 

1.26 

1.13 

1.08 

1000 

1. 

,59 

1.57 

1. 

54 

1.52 

1.50 

1.46 

1.42 

1.39 

1.35 

1.24 

1.11 

1.00 

00 
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Table  E-3  Thompson's  Tau 


Sample  Level  of  Significance 

Size 


N  P 

«— s 

11 

.05 

.02 

.01 

3 

1.3968 

1.4099 

1.41352 

1.414039 

4 

1.559 

1.6080 

1.6974 

1.7147 

5 

1.611 

1.757 

1.869 

1.9175 

6 

1.631 

1.814 

1.973 

2.0509 

7 

1.640 

1.848 

2.040 

2.142 

8 

1.644 

1.870 

2.087 

2.207 

1.647 

1.885 

2.121 

2.256 

1.648 

1.895 

2.146 

2.294 

JBM 

1.648 

1.904 

2.166 

2.324 

1.649 

1.910 

2.183 

2.348 

1.649 

1.915 

2.196 

2.368 

1  - 

1.649 

1.919 

2.207 

2.385 

15 

1.649 

1.923 

2.216 

2.399 

16 

1.649 

1.926 

2.224 

2.411 

17 

1.649 

1.928 

2.231 

2.422 

18 

1.649 

1.931 

2.237 

2.432 

19 

1.649 

1.932 

2.242 

2.440 

20 

1.649 

1.934 

2.247 

2.447 

21 

1.649 

1.936 

2.251 

2.454 

22 

1.649 

1.937 

2.255 

2.460 

23 

1.649 

1.938 

2.259 

2.465 

24 

1.649 

1.940 

2.262 

2.470 

25 

1.649 

1.941 

2.264 

■2.475 

26 

1.648 

1.942 

2.267 

2.479 

27 

1.648 

1.942 

2.269 

2.483 

28 

1.648 

1.943 

2.272 

2.487 

29 

1.648 

1.944 

2.274 

2.490 

30 

1.648 

1.944 

2.275 

2.493 

31 

1.648 

1.945 

2.277 

2.495 

32 

1.648 

1.945 

2.279 

2.498 

CD 

1.64485 

1.95996 

2.32634 

2.57582 
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and 


These  are  the  average  value  and  standard  deviation  of  the  sample. 

2.  Calculate  the  difference  in  (absolute  value)  between  the  average  value  X 
and  the  outlier  X 

8  =  |x-X'| 

3.  Entering  the  table  for  N  and  P,  (take  P  =  0.05)  read  a  value  of  Tau. 

4.  The  comparison  is  made  between  5  and  the  product  of  SD  and  Tau.  If  5 
is  larger  or  equal  to  that  product,  the  data  point  is  declared  an  outlier.  A 
new  mean  and  standard  deviation  must  be  calculated.  If  5  is  smaller,  the 
point  is  not  rejected. 


Example : 


In  the  following  sample  of  15  data  points,  X  and  S  were  calculated  to  be  9.949  and 
0.997: 


9.558 

10.478 

9.609 

9.582 

9.583 

11.447 

11.485 

11.067 

9.173 

10.303 

10.472 

10.310 

7.416 

9.488 

9.257 

Suspected  outlier 


The  test  is  to  compare  5  (the  absolute  difference  between  the  suspected  outlier  and 
the  average  value)  with  the  product  Tau  value  times  calculated  standard  deviation. 

8  =  |x  -  X'|  =  |9.949  -7. 416 1  =  2.533 

Tau  x  SD  =  1.923  x  0.997  =  1.917 

where  Tau  is  the  Table  E-3  value  for  P  =  0.05  and  N  =15.  Since  5  is  greater,  the  point 
7.416  is  discarded. 
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